-- Logs begin at Wed 2022-07-06 19:32:48 UTC, end at Wed 2022-07-06 20:48:55 UTC. -- Jul 06 20:16:44.456011 dv-cinder-848899-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 06 20:16:44.464493 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 6 20:16:44 2022] *** Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: nodename: dv-cinder-848899-1-iscsi Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: machine: x86_64 Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: clock source: unix Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: pcre jit disabled Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: detected number of CPU cores: 4 Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: current working directory: / Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: detected binary path: /usr/bin/uwsgi-core Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: your processes number limit is 47680 Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: your memory page size is 4096 bytes Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: detected max file descriptor number: 2048 Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: lock engine: pthread robust mutexes Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: thunder lock: enabled Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 06 20:16:44.469942 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 06 20:16:44.511335 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: Python main interpreter initialized at 0x55c5f2f3f9c0 Jul 06 20:16:44.511335 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: python threads support enabled Jul 06 20:16:44.511335 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: your server socket listen backlog is limited to 100 connections Jul 06 20:16:44.511335 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: your mercy for graceful operations on workers is 90 seconds Jul 06 20:16:44.511673 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: mapped 403077 bytes (393 KB) for 2 cores Jul 06 20:16:44.511751 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: *** Operational MODE: preforking *** Jul 06 20:16:44.512016 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: *** uWSGI is running in multiple interpreter mode *** Jul 06 20:16:44.512016 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: spawned uWSGI master process (pid: 80323) Jul 06 20:16:44.512227 dv-cinder-848899-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 06 20:16:44.517165 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: spawned uWSGI worker 1 (pid: 80331, cores: 1) Jul 06 20:16:44.517165 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: spawned uWSGI worker 2 (pid: 80332, cores: 1) Jul 06 20:16:44.517165 dv-cinder-848899-1-iscsi devstack@keystone.service[80323]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 06 20:16:49.870970 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 20:16:49.870970 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: from cryptography.utils import int_from_bytes Jul 06 20:16:49.871681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 20:16:49.871681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: from cryptography.utils import int_from_bytes Jul 06 20:16:49.871681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 20:16:49.871681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: from cryptography.utils import int_from_bytes Jul 06 20:16:49.872173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 20:16:49.872173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: from cryptography.utils import int_from_bytes Jul 06 20:16:49.920352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 20:16:49.920531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 20:16:49.920613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 20:16:49.920688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 20:16:49.920747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] command line args: [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 20:16:49.920885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] command line args: [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 20:16:49.920986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 20:16:49.921186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ================================================================================ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 20:16:49.921305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 20:16:49.921305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ================================================================================ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 20:16:49.921441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] admin_token = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.921573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] admin_token = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.921650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] config_dir = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.921838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.921967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] config_dir = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.922048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] config_source = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.922108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.922176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] debug = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.922241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] config_source = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.922374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] debug = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.922457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.922673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.922757 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.922815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.922870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.922931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.923148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.923294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.923434 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.923566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.923691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.923815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.923939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_config_append = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.924058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] log_config_append = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.924131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.924188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_dir = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] log_dir = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] log_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.925973 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.926044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.926119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.926192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.926268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.926335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.926426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.926492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.926690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.926798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.926908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.926987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.927058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.927132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.927208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.927286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.927398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.927471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.927595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.927669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.927785 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.927858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.928019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.928140 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.928220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.928343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] publish_errors = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.928417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] publish_errors = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.928527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.928614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.928684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.928794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.928872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.929008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.929078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.929164 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.929342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.929464 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.929550 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] standard_threads = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.929678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] standard_threads = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.929764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.929840 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930027 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930388 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] use_journal = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] use_journal = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] use_json = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930661 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] use_json = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] use_stderr = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] use_stderr = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] use_syslog = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.930960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] use_syslog = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.931029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.931102 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:16:49.931313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.931455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.931535 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.931612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.931805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.931927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.932012 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.932099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.932277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.932400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.932476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.932545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.932749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.932882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.933006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.933094 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.933245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.933373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.933458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.933539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.933734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.933855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.933941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.934018 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.934198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.934337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.934423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.934497 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.934667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.934788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.934874 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.935034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.935108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.935176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.935385 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.935505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.935620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.935723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.935884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.936006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.936093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.936163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.936341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.936435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.936697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.936782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.936999 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.937081 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.937225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.937321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.937453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.937533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.937684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.937763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.937912 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.937991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.938145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.938231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.938391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.938475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.938634 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.938714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.938864 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.938944 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.939089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.939167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.939333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.939412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.939579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.939656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.939814 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.939894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.940063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.940143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.940276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.940349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.940505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.940579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.940725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.940802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.940977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.941055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.941204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.941290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.941433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.941508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.941659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.941733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.941894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.941968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.942142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.942223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.942370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.942444 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.942603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.942677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.942833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.942909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.943066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.943140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.943382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.943464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.943590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.943664 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.943823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.943964 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.944172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.944282 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.944362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.944435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.944524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.944656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.944779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.944893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.945069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.945174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.945277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.945408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.945516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.945652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.945766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.945878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.946010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.946134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.946238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.946691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.946845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.946950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.947065 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.947198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.947301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.947411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.947547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.947651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.947762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.947895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.947997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.948101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.948230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.948350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.948456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.948558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.948660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.948763 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.948868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949004 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949111 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949404 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949515 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.949941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.950122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.950282 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.950372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.950446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.950557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.950655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.950813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.950936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.951013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.951085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.951294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.951434 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.951555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.951636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.951731 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.951814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.951992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.952203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.952203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.952346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.952417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.952487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.952672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.952813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.952906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.953021 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.953097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.953166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.953363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.953487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.953563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.953652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.953806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.953940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.954019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.954091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.954273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.954410 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.954491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.954561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.954727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.954852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.954943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.955024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.955198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.955331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.955411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.955488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.955681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.955804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.955880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.external = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.955949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.external = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.956124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.956257 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.956425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.956579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.956671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.956745 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.956817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.password = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.956886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.password = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.957101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.token = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.957225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.token = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.957323 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.957398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.957561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.957685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.957762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.957833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.958023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.958146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.958224 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.958294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.958499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.958623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.958715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.958797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.958946 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.959069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.959213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.959282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.959449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.959528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.959760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.959968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.960043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.960237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.960346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.960450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.960526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.960736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.960844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.961098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.961196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.961270 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.961344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.961487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.961611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.961735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.961831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.962006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.962128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.962244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.962332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.962538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.962640 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.962719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.962800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.962986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.963110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.963201 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.963274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.963451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.963585 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.963664 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.963735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.963911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.964036 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.964113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.964185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.964378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.964503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.964598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.964673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.964851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.965012 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.965094 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.965166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.965347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.965471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.965549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.965620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.965809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.966016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.966016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.966158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.966267 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.966355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.966520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.966656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.966738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.966809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.966984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.967109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.967187 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.967272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.967432 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.967556 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.967635 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.967705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.967909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.968046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.968127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.968198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.968352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.968476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.968563 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.968646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.968807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.968931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.969102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.969182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.969291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.969390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.969559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.969684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.969772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.969845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.970058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.970196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.970277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.970349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.970513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.970637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.970714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.970805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.970968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.971092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.971181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.971254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.971412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.971548 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.971629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.971705 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.971873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.971997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.972075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.972161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.972338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.972462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.972539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.972609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.972816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.973015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.973102 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.973175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.973322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.973447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.973544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.973626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.973780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.973904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.973982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.974063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.974228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.974368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.974448 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.974519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.974682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.974807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.974937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.975035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.975169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.975252 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.975401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.975483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.975650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.975744 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.975897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.975982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.976127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.976212 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.976355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.976446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.976601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.976684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.976848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.976930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.977105 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.977203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.977340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.977423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.977575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.977657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.977804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.977885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.978023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.978099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.978278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.978357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.978505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.978584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.978751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.978828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.978995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.979071 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.979236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.979314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.979468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.979547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.979697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.979773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.979927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.980049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.980159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.980236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.980389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.980465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.980615 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.980693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.980857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.980933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.981126 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.981244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.981370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.981483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.981595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.981707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.981818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.981930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.982048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.982161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.982272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.982382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.982493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.982604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.982724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.982836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.982947 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.983057 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.983168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.983279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.983398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.983510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.983621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.983734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.983844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.983959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.984078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.984190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.984302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.984411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.984543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.984659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.984779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.984891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.985105 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.985220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.985332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.985443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.985568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.985681 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.985792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.985905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.986016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.986127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.986246 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.986359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.986470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.986581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.986692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.986803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.986923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.987036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.987148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.987259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.987370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.987481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.987600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.987714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.987825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.987937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.988048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.988157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.988347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.988462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.988573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.988684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.988795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] role.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.988905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] role.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.989044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] role.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.989158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] role.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.989271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.989381 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.989492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.989603 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.989722 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.989835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.989946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.990058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.990169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.990287 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.990458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.990577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.990688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.990800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.990923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.991044 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.991158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.991274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.991387 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.991498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.991609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.991728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.991840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.991952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.992063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.992177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.992290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.992409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.992583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.992700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.992811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.992922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.993086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.993198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.993321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.993425 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.993570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.993673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.993820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.993931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.994055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.994163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.995071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.995071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.995071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.995071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.995480 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.995573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.995675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.995787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.995907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.996019 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.996129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.996238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.996350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.996460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.996578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.996690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.996801 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.996910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.997050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.997163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.997282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] token.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.997395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.997505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.997615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.997724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.997835 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.997957 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.998069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.998179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.998290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.998403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.998513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.998631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.998742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.998852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.998962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.999072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.999182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.999301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.999413 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.999525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.999636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.999746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.999856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:49.999974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.000085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.000198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.000308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.000418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.000529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.000647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.000758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.000868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.001035 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.001035 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.001246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.001369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.001481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.001601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.001720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.001831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.001941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.002058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.002172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.002290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.002400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.002518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.002638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.002749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.002862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.002972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.003090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.003202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.003312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.003423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.003566 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.003679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.003798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.003910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.004021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.004131 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.004241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.004351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.004470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.004895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.005020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.005132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.005242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.005352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.005474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.005586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.005696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.005807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.005917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.006097 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 20:16:50.006223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.006223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.006469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.006704 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:16:50.006874 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 20:16:50.036597 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.036829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.037082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.037172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.037440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.037664 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.045556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.046048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.073732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.073870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.073947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.074082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.216984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.217186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.265255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.265496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.265686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.265912 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.328543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.328769 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.328970 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.329221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.329343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.329420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.329494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.329607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.329697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.329865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.330079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.330291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.354417 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.354576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.354685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.354799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.354883 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.354956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.355023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.355104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.355253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.355377 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.355453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.355519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.355669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.355806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.366934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.367141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.379915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.380145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.380350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.380446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.380522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.380588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.380765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.380902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.381028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.381107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.381211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.381298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.381445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.381630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:16:50.398650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.398828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.398923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 20:16:50.399068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 20:16:50.399212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.399367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 20:16:50.399494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.399573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 20:16:50.399638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.399840 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.399963 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.400082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.400172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.400355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.400480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.400570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.411161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.411387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.411511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.411631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.411722 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.411915 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.412040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.412193 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.420240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.420445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.423515 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.423739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.423864 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.424029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.424153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.424250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.424328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.424559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.424682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.424802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.424906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.425109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.425232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.425355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.425448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.425641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.425782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.425865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.425936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.426122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.426244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.426413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.452568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.453210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.454201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.454475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.454810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.455082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.459796 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.460071 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.460384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.460508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.460612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.461067 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.467726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.467947 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.468258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.468542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.472359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.472643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.472924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.473070 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.473203 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.473291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.473490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.473613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.473766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.473891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.473983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.474059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.474282 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.474406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.474567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.474854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.492833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.493130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.493383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.493652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.497689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.498202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.501376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.501669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.501792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.502088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.507124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.507561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.510741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.511194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.514369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.514628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.514749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.514947 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.515072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.515250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.515374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.515539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.515663 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.515818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.515943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.516163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.534793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.535073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.535196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.535310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.535417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.535601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.535724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.535843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.543538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.543756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.545271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.545439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.545524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.545718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.548675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.548898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.549062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.549145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.549217 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.549435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.549574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.549729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.549853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.550060 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.563018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.563166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.563247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.563448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.563572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.563745 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.563869 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.563988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.564078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.564288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.565673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.565849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.565943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.566167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.583637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.583843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.586999 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.587125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.590296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.590421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.592028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.592173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.593686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.593811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.593971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.594096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.594257 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.594401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.601547 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.601672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.603137 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.603263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.606374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.606500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.606661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.606786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.607049 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.607192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.607298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.607386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.616390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.616513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.616670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.616813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.616920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.617046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.624724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.624848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:16:50.624997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.625089 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.625282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.625404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.625550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.625644 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.625840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.625963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.626209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.626334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.626482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.626618 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.626728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.626819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.626979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.627126 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.627285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.627411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.627555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.627680 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.627789 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.627868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.628075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.628198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.628303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.628395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:16:50.666160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c5f2f3f9c0 pid: 80332 (default app) Jul 06 20:16:50.666288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c5f2f3f9c0 pid: 80331 (default app) Jul 06 20:16:50.669579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b140e77-ae6e-4253-95ac-6eb6a7bf7403 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:16:50.669868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b140e77-ae6e-4253-95ac-6eb6a7bf7403 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:16:50.670152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b140e77-ae6e-4253-95ac-6eb6a7bf7403 None None] PATH_INFO: `/v3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:16:50.674483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Wed Jul 6 20:16:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:16:58.265626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228658d-b0dc-4dab-bb08-ef9415dd9bbc None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:16:58.266519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228658d-b0dc-4dab-bb08-ef9415dd9bbc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:16:58.266519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228658d-b0dc-4dab-bb08-ef9415dd9bbc None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:16:58.273798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:16:58 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:16:58.279350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c6968-a84c-4324-88af-7d310b147a13 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:16:58.279779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c6968-a84c-4324-88af-7d310b147a13 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:16:58.279867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c6968-a84c-4324-88af-7d310b147a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:16:58.348793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: INFO dbcounter [None req-9a5c6968-a84c-4324-88af-7d310b147a13 None None] Registered counter for database keystone Jul 06 20:16:58.373426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5c6968-a84c-4324-88af-7d310b147a13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 20:16:58.384465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writer thread running {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 20:16:58.569615 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG passlib.handlers.bcrypt [None req-9a5c6968-a84c-4324-88af-7d310b147a13 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80332) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 06 20:16:58.569944 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG passlib.handlers.bcrypt [None req-9a5c6968-a84c-4324-88af-7d310b147a13 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80332) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 06 20:16:58.625254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9a5c6968-a84c-4324-88af-7d310b147a13 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:16:58.626857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9a5c6968-a84c-4324-88af-7d310b147a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:16:58.757209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:16:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 06 20:16:58.976390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228658d-b0dc-4dab-bb08-ef9415dd9bbc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:16:59.050513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: INFO dbcounter [None req-e228658d-b0dc-4dab-bb08-ef9415dd9bbc None None] Registered counter for database keystone Jul 06 20:16:59.072116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG oslo_db.sqlalchemy.engines [None req-e228658d-b0dc-4dab-bb08-ef9415dd9bbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 20:16:59.080023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writer thread running {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 20:16:59.208850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228658d-b0dc-4dab-bb08-ef9415dd9bbc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:16:59.214287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5c338-d97b-417b-9c34-b41153edc593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:16:59.214953 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c338-d97b-417b-9c34-b41153edc593 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:16:59.215233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c338-d97b-417b-9c34-b41153edc593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:16:59.215505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c338-d97b-417b-9c34-b41153edc593 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:16:59.224460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5c338-d97b-417b-9c34-b41153edc593 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:16:59.275464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: WARNING keystone.common.rbac_enforcer.enforcer [None req-32f5c338-d97b-417b-9c34-b41153edc593 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 06 20:16:59.276273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5c338-d97b-417b-9c34-b41153edc593 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:16:59.286265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jul 6 20:16:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 20:16:59.293736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c6968-a84c-4324-88af-7d310b147a13 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:16:59.317180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c6968-a84c-4324-88af-7d310b147a13 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:16:59.324123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0b36f-979b-45aa-b1ba-7e45001fa50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:16:59.325312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b36f-979b-45aa-b1ba-7e45001fa50b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:16:59.325600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b36f-979b-45aa-b1ba-7e45001fa50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:16:59.325871 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b36f-979b-45aa-b1ba-7e45001fa50b admin admin] PATH_INFO: `/v3/projects/b9dceb457eba4f588d26a4848fffb9ba` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:16:59.330211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0b36f-979b-45aa-b1ba-7e45001fa50b admin admin] RBAC: Authorizing `identity:get_project(project_id=b9dceb457eba4f588d26a4848fffb9ba)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:16:59.379826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: WARNING keystone.common.rbac_enforcer.enforcer [None req-09e0b36f-979b-45aa-b1ba-7e45001fa50b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 06 20:16:59.380450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0b36f-979b-45aa-b1ba-7e45001fa50b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:16:59.385173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Wed Jul 6 20:16:59 2022] GET /identity/v3/projects/b9dceb457eba4f588d26a4848fffb9ba => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:01.364816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe52eb-2394-455f-b450-5436309dbf32 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:01.365695 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe52eb-2394-455f-b450-5436309dbf32 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:01.365802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe52eb-2394-455f-b450-5436309dbf32 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:01.372643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:01.379304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d199-2bbe-497f-a80c-553560dfcae3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:01.380037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d199-2bbe-497f-a80c-553560dfcae3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:01.380187 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d199-2bbe-497f-a80c-553560dfcae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:01.400946 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7142d199-2bbe-497f-a80c-553560dfcae3 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:01.402849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7142d199-2bbe-497f-a80c-553560dfcae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:01.412161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 06 20:17:01.433915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe52eb-2394-455f-b450-5436309dbf32 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:01.449579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe52eb-2394-455f-b450-5436309dbf32 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:01.455302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4d59e-5785-4537-8264-449721db7b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:01.455940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d59e-5785-4537-8264-449721db7b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:01.456224 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d59e-5785-4537-8264-449721db7b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:01.456500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d59e-5785-4537-8264-449721db7b4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:01.465276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4d59e-5785-4537-8264-449721db7b4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:01.467066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4d59e-5785-4537-8264-449721db7b4d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:01.476686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Wed Jul 6 20:17:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:17:01.484760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142d199-2bbe-497f-a80c-553560dfcae3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:01.499272 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142d199-2bbe-497f-a80c-553560dfcae3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:01.508005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58059f8f-d722-4324-ae21-e5b67330861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:01.508868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059f8f-d722-4324-ae21-e5b67330861e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:01.509259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059f8f-d722-4324-ae21-e5b67330861e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:01.509531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059f8f-d722-4324-ae21-e5b67330861e admin admin] PATH_INFO: `/v3/users/7606b528dcd64b439b296d632d31e16c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:01.511145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58059f8f-d722-4324-ae21-e5b67330861e admin admin] RBAC: Authorizing `identity:get_user(user_id=7606b528dcd64b439b296d632d31e16c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:01.512985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58059f8f-d722-4324-ae21-e5b67330861e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:01.514575 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Wed Jul 6 20:17:01 2022] GET /identity/v3/users/7606b528dcd64b439b296d632d31e16c => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:03.542146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4faf0d-4d5b-40f5-ad6b-60348382d73c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:03.542683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4faf0d-4d5b-40f5-ad6b-60348382d73c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:03.542683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4faf0d-4d5b-40f5-ad6b-60348382d73c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:03.544036 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:03.549263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff3dc3-5fa0-4abc-801b-ff9587bcecba None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:03.549668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff3dc3-5fa0-4abc-801b-ff9587bcecba None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:03.549952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff3dc3-5fa0-4abc-801b-ff9587bcecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:03.567611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d5ff3dc3-5fa0-4abc-801b-ff9587bcecba None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:03.568821 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d5ff3dc3-5fa0-4abc-801b-ff9587bcecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:03.583092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41506-a0d8-4677-a6ff-da8e6f99af64 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:03.583377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41506-a0d8-4677-a6ff-da8e6f99af64 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:03.583652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41506-a0d8-4677-a6ff-da8e6f99af64 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:03.585063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:03.589743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac03c3-4a4f-4feb-b4e1-310d0dec6278 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:03.590030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac03c3-4a4f-4feb-b4e1-310d0dec6278 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:03.590309 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac03c3-4a4f-4feb-b4e1-310d0dec6278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:03.629684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG passlib.handlers.bcrypt [None req-0eac03c3-4a4f-4feb-b4e1-310d0dec6278 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80331) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 06 20:17:03.630100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG passlib.handlers.bcrypt [None req-0eac03c3-4a4f-4feb-b4e1-310d0dec6278 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80331) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 06 20:17:03.653164 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:03.675598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0eac03c3-4a4f-4feb-b4e1-310d0dec6278 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:03.675958 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff3dc3-5fa0-4abc-801b-ff9587bcecba None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:03.677222 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0eac03c3-4a4f-4feb-b4e1-310d0dec6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:03.700293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:03.780843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:03.781904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff3dc3-5fa0-4abc-801b-ff9587bcecba None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:03.803278 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac03c3-4a4f-4feb-b4e1-310d0dec6278 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:03.818918 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed050-8b38-40fd-8cbc-28d4eacbebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:03.819775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed050-8b38-40fd-8cbc-28d4eacbebc1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:03.820055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed050-8b38-40fd-8cbc-28d4eacbebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:03.820416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed050-8b38-40fd-8cbc-28d4eacbebc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:03.833910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eed050-8b38-40fd-8cbc-28d4eacbebc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-60eed050-8b38-40fd-8cbc-28d4eacbebc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:03.845236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:03.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:03.846949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:17:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:03.852338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed050-8b38-40fd-8cbc-28d4eacbebc1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:03.906970 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac03c3-4a4f-4feb-b4e1-310d0dec6278 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:03.909317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:03.934704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:03.945085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d112a8d-c297-4251-8da4-b5ea01431b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:03.945996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112a8d-c297-4251-8da4-b5ea01431b71 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:03.946280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112a8d-c297-4251-8da4-b5ea01431b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:03.946561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112a8d-c297-4251-8da4-b5ea01431b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:03.952799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed050-8b38-40fd-8cbc-28d4eacbebc1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:03.987845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5402d-5328-43e4-97f0-0fdcf742c41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:03.988514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5402d-5328-43e4-97f0-0fdcf742c41b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:03.988768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5402d-5328-43e4-97f0-0fdcf742c41b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:03.989069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5402d-5328-43e4-97f0-0fdcf742c41b None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:03.989836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5402d-5328-43e4-97f0-0fdcf742c41b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:03.990145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5402d-5328-43e4-97f0-0fdcf742c41b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:03.991642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5402d-5328-43e4-97f0-0fdcf742c41b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:04.003670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:04.009825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5402d-5328-43e4-97f0-0fdcf742c41b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:04.013363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d112a8d-c297-4251-8da4-b5ea01431b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:04.014938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d112a8d-c297-4251-8da4-b5ea01431b71 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:04.115370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5402d-5328-43e4-97f0-0fdcf742c41b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:04.115559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:17:04.121323 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d112a8d-c297-4251-8da4-b5ea01431b71 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:04.124295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:04.149988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9479be-43b3-4a47-b888-d23ce054024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:04.150868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9479be-43b3-4a47-b888-d23ce054024b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:04.151148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9479be-43b3-4a47-b888-d23ce054024b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:04.151419 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9479be-43b3-4a47-b888-d23ce054024b None admin] PATH_INFO: `/v3/users/7606b528dcd64b439b296d632d31e16c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:04.152631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9479be-43b3-4a47-b888-d23ce054024b None admin] RBAC: Authorizing `identity:get_user(user_id=7606b528dcd64b439b296d632d31e16c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:04.154138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9479be-43b3-4a47-b888-d23ce054024b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:04.155785 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:04 2022] GET /identity/v3/users/7606b528dcd64b439b296d632d31e16c => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:04.161060 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9479be-43b3-4a47-b888-d23ce054024b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:04.175637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:04.223704 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d112a8d-c297-4251-8da4-b5ea01431b71 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:04.258462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312a68e-daa1-4041-83b9-99ef76c56181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:04.258787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9479be-43b3-4a47-b888-d23ce054024b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:04.259260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312a68e-daa1-4041-83b9-99ef76c56181 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:04.259542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312a68e-daa1-4041-83b9-99ef76c56181 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:04.259819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312a68e-daa1-4041-83b9-99ef76c56181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:04.278879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312a68e-daa1-4041-83b9-99ef76c56181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:04.280374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312a68e-daa1-4041-83b9-99ef76c56181 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:04.293421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19a159-4c4b-4f73-ba5f-1f25e7d57258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:04.294208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19a159-4c4b-4f73-ba5f-1f25e7d57258 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:04.294488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19a159-4c4b-4f73-ba5f-1f25e7d57258 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:04.294756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19a159-4c4b-4f73-ba5f-1f25e7d57258 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:04.295923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19a159-4c4b-4f73-ba5f-1f25e7d57258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:04.297381 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19a159-4c4b-4f73-ba5f-1f25e7d57258 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:04.298993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 10/18] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4312a68e-daa1-4041-83b9-99ef76c56181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:17:04.301792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:04.302771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:04.303603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:17:04.303603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:17:04.303603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:17:04.303603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:04.303603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 9/19] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:04.304601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19a159-4c4b-4f73-ba5f-1f25e7d57258 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:04.308787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312a68e-daa1-4041-83b9-99ef76c56181 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:04.366009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:04.388603 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:04.408189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19a159-4c4b-4f73-ba5f-1f25e7d57258 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:04.409481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312a68e-daa1-4041-83b9-99ef76c56181 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:04.442127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3df8cd-3b24-4b7a-b407-380b73275ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:04.442784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df8cd-3b24-4b7a-b407-380b73275ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:04.443064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df8cd-3b24-4b7a-b407-380b73275ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:04.443158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90675c9b-b6f7-4bfe-bcf2-085ad419e1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:04.443335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df8cd-3b24-4b7a-b407-380b73275ef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:04.443768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90675c9b-b6f7-4bfe-bcf2-085ad419e1ce None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:04.444067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90675c9b-b6f7-4bfe-bcf2-085ad419e1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:04.444250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3df8cd-3b24-4b7a-b407-380b73275ef4 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.domain.id=default, user.id=7606b528dcd64b439b296d632d31e16c) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:04.444406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90675c9b-b6f7-4bfe-bcf2-085ad419e1ce None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:04.444562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3df8cd-3b24-4b7a-b407-380b73275ef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:04.445176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90675c9b-b6f7-4bfe-bcf2-085ad419e1ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:04.445489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90675c9b-b6f7-4bfe-bcf2-085ad419e1ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:04.446036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3df8cd-3b24-4b7a-b407-380b73275ef4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:04.446889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90675c9b-b6f7-4bfe-bcf2-085ad419e1ce None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:04.452736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1322 bytes} [Wed Jul 6 20:17:04 2022] GET /identity/v3/role_assignments?user.id=7606b528dcd64b439b296d632d31e16c&scope.domain.id=default&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:04.465350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 10/21] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:06.760073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15923-0007-4dbe-b07b-7804e28e7868 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:06.760607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15923-0007-4dbe-b07b-7804e28e7868 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:06.760607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15923-0007-4dbe-b07b-7804e28e7868 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:06.762007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:06.767384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd3b9-98ae-44a2-a096-254f78bff118 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:06.767777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd3b9-98ae-44a2-a096-254f78bff118 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:06.767956 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd3b9-98ae-44a2-a096-254f78bff118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:06.799321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e79dd3b9-98ae-44a2-a096-254f78bff118 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:06.800515 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e79dd3b9-98ae-44a2-a096-254f78bff118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:06.815920 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59f67-89f1-4173-8e3e-521cd1d0f682 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:06.816205 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59f67-89f1-4173-8e3e-521cd1d0f682 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:06.816475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59f67-89f1-4173-8e3e-521cd1d0f682 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:06.818069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 13/23] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:17:06.823315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac58191-13fd-47e7-86e6-985d09a44c6e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:06.823604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac58191-13fd-47e7-86e6-985d09a44c6e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:06.823886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac58191-13fd-47e7-86e6-985d09a44c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:06.847403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-aac58191-13fd-47e7-86e6-985d09a44c6e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:06.848599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aac58191-13fd-47e7-86e6-985d09a44c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:06.927309 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 11/24] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:06.956120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd3b9-98ae-44a2-a096-254f78bff118 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:07.018032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 14/25] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:07.044703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:07.057541 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac58191-13fd-47e7-86e6-985d09a44c6e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:07.139031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd3b9-98ae-44a2-a096-254f78bff118 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:07.209355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194fd0b-6db3-48e8-9bd7-ffa3329fa0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:07.210256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194fd0b-6db3-48e8-9bd7-ffa3329fa0ba None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:07.210542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194fd0b-6db3-48e8-9bd7-ffa3329fa0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:07.210967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194fd0b-6db3-48e8-9bd7-ffa3329fa0ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:07.242072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194fd0b-6db3-48e8-9bd7-ffa3329fa0ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:07.242871 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e194fd0b-6db3-48e8-9bd7-ffa3329fa0ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:07.251022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:07.251879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:07.252602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 12/26] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:07.259960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194fd0b-6db3-48e8-9bd7-ffa3329fa0ba None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:07.310865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac58191-13fd-47e7-86e6-985d09a44c6e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:07.408788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194fd0b-6db3-48e8-9bd7-ffa3329fa0ba None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:07.414334 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6c46a-b7f9-4189-8a5c-ad4be7438163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:07.415269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c46a-b7f9-4189-8a5c-ad4be7438163 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:07.415644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c46a-b7f9-4189-8a5c-ad4be7438163 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:07.416009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c46a-b7f9-4189-8a5c-ad4be7438163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:07.421393 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:07.442096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6c46a-b7f9-4189-8a5c-ad4be7438163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:07.443934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6c46a-b7f9-4189-8a5c-ad4be7438163 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8da6c46a-b7f9-4189-8a5c-ad4be7438163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:17:07.464043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:07.464865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:07.465708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:17:07.465708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:17:07.465708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:17:07.465708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:07.467785 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 15/27] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:07.467891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc94ef4-1742-42b3-b1d7-cab06ea4890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:07.468689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc94ef4-1742-42b3-b1d7-cab06ea4890b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:07.473382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc94ef4-1742-42b3-b1d7-cab06ea4890b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:07.473382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc94ef4-1742-42b3-b1d7-cab06ea4890b None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:07.473382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc94ef4-1742-42b3-b1d7-cab06ea4890b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:07.473382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc94ef4-1742-42b3-b1d7-cab06ea4890b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:07.473382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc94ef4-1742-42b3-b1d7-cab06ea4890b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:07.474473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d2ea-6c86-4b86-9b00-d37f12439305 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:07.474923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d2ea-6c86-4b86-9b00-d37f12439305 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:07.475361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d2ea-6c86-4b86-9b00-d37f12439305 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:07.477316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 16/28] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:07.478563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f955d-0a36-41bc-9bf8-9cfe843590b0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:07.479015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f955d-0a36-41bc-9bf8-9cfe843590b0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:07.479449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f955d-0a36-41bc-9bf8-9cfe843590b0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:07.484682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 17/29] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:07.485674 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f955d-0a36-41bc-9bf8-9cfe843590b0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:07.489608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 13/30] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:07.491138 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad408c-554b-4ad3-89ef-422c4df3749b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:07.491500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad408c-554b-4ad3-89ef-422c4df3749b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:07.491848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad408c-554b-4ad3-89ef-422c4df3749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:07.509470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-63ad408c-554b-4ad3-89ef-422c4df3749b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:07.511217 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-63ad408c-554b-4ad3-89ef-422c4df3749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:07.595649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 14/31] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:07.597368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272482b6-f380-4ead-9cbe-eca1a979c57b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:07.597807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272482b6-f380-4ead-9cbe-eca1a979c57b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:07.598230 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272482b6-f380-4ead-9cbe-eca1a979c57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:07.605635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f955d-0a36-41bc-9bf8-9cfe843590b0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:07.630416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-272482b6-f380-4ead-9cbe-eca1a979c57b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:07.632074 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-272482b6-f380-4ead-9cbe-eca1a979c57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:07.640218 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:07.651546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674780d-192e-4b16-8efa-3e2871b73b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:07.652623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674780d-192e-4b16-8efa-3e2871b73b56 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:07.653142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674780d-192e-4b16-8efa-3e2871b73b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:07.653612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674780d-192e-4b16-8efa-3e2871b73b56 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:07.654674 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674780d-192e-4b16-8efa-3e2871b73b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:07.655203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674780d-192e-4b16-8efa-3e2871b73b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:07.656901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674780d-192e-4b16-8efa-3e2871b73b56 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:07.678313 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 18/32] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:07.679513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674780d-192e-4b16-8efa-3e2871b73b56 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:07.721710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 15/33] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:07.726601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272482b6-f380-4ead-9cbe-eca1a979c57b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:07.769979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:07.832402 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674780d-192e-4b16-8efa-3e2871b73b56 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:07.849922 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272482b6-f380-4ead-9cbe-eca1a979c57b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:07.883954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2548b-9206-4663-935a-b51cff660e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:07.884927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2548b-9206-4663-935a-b51cff660e45 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:07.885241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2548b-9206-4663-935a-b51cff660e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:07.885593 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2548b-9206-4663-935a-b51cff660e45 None admin] PATH_INFO: `/v3/users/7606b528dcd64b439b296d632d31e16c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:07.886975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2548b-9206-4663-935a-b51cff660e45 None admin] RBAC: Authorizing `identity:get_user(user_id=7606b528dcd64b439b296d632d31e16c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:07.887309 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b4c34-1574-4f88-a0d4-b4e4eceda7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:07.888191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b4c34-1574-4f88-a0d4-b4e4eceda7c2 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:07.888457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2548b-9206-4663-935a-b51cff660e45 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:07.888883 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b4c34-1574-4f88-a0d4-b4e4eceda7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:07.889376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b4c34-1574-4f88-a0d4-b4e4eceda7c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:07.890377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b4c34-1574-4f88-a0d4-b4e4eceda7c2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:07.890495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 19/34] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:07 2022] GET /identity/v3/users/7606b528dcd64b439b296d632d31e16c => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:07.891343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2548b-9206-4663-935a-b51cff660e45 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:07.892361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b4c34-1574-4f88-a0d4-b4e4eceda7c2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:07.952209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:07.999636 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2548b-9206-4663-935a-b51cff660e45 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:08.030605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 16/35] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Jul 6 20:17:07 2022] POST /identity/v3/roles => generated 219 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:08.031932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b4c34-1574-4f88-a0d4-b4e4eceda7c2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:08.035278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8e25b-e92d-4e98-b0c0-3090ad05e2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:08.036073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8e25b-e92d-4e98-b0c0-3090ad05e2e3 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:08.036361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8e25b-e92d-4e98-b0c0-3090ad05e2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:08.036638 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8e25b-e92d-4e98-b0c0-3090ad05e2e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:08.037453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8e25b-e92d-4e98-b0c0-3090ad05e2e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:08.039179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8e25b-e92d-4e98-b0c0-3090ad05e2e3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:08.147521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:08.155335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b4c34-1574-4f88-a0d4-b4e4eceda7c2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:08.192935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea80d5b-be2b-43da-828f-0d2548c431e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:08.194063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea80d5b-be2b-43da-828f-0d2548c431e4 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:08.194613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea80d5b-be2b-43da-828f-0d2548c431e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:08.195079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea80d5b-be2b-43da-828f-0d2548c431e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:08.196045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea80d5b-be2b-43da-828f-0d2548c431e4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:08.197849 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea80d5b-be2b-43da-828f-0d2548c431e4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:08.216101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 17/36] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Jul 6 20:17:08 2022] POST /identity/v3/roles => generated 225 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:08.217438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea80d5b-be2b-43da-828f-0d2548c431e4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:08.228755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 20/37] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:17:07 2022] POST /identity/v3/projects => generated 301 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:08.230997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be931a7-9d36-4f5c-a924-5b10270dfbcb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:08.231548 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be931a7-9d36-4f5c-a924-5b10270dfbcb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:08.232048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be931a7-9d36-4f5c-a924-5b10270dfbcb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:08.233814 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 21/38] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:08.236042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8164fd-d05d-42df-890f-1f9c2ad74171 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:08.236641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8164fd-d05d-42df-890f-1f9c2ad74171 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:08.237132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8164fd-d05d-42df-890f-1f9c2ad74171 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:08.239604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 22/39] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:08.244201 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3950-5db3-423a-a4c2-660694e468bd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:08.244869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3950-5db3-423a-a4c2-660694e468bd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:08.245359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3950-5db3-423a-a4c2-660694e468bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:08.266644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d48b3950-5db3-423a-a4c2-660694e468bd None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:08.268800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d48b3950-5db3-423a-a4c2-660694e468bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:08.354616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 23/40] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:08.356358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aa63f-97a7-478d-8ac5-ed117ec874c0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:08.356846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aa63f-97a7-478d-8ac5-ed117ec874c0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:08.357351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aa63f-97a7-478d-8ac5-ed117ec874c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:08.369017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea80d5b-be2b-43da-828f-0d2548c431e4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:08.379251 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-738aa63f-97a7-478d-8ac5-ed117ec874c0 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:08.381185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-738aa63f-97a7-478d-8ac5-ed117ec874c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:08.422111 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:08.433264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cbf73-9c37-42da-8a6a-b599af6ee52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:08.434452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cbf73-9c37-42da-8a6a-b599af6ee52c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:08.434936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cbf73-9c37-42da-8a6a-b599af6ee52c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:08.435414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cbf73-9c37-42da-8a6a-b599af6ee52c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:08.437360 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cbf73-9c37-42da-8a6a-b599af6ee52c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:08.439166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cbf73-9c37-42da-8a6a-b599af6ee52c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:08.441122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 18/41] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:08.442174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cbf73-9c37-42da-8a6a-b599af6ee52c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:08.472876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:08.473088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 24/42] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:08.473873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aa63f-97a7-478d-8ac5-ed117ec874c0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:08.567418 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cbf73-9c37-42da-8a6a-b599af6ee52c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:08.602469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b3093-e7b0-45e4-a62a-dbcfa9a4476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:08.603276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b3093-e7b0-45e4-a62a-dbcfa9a4476d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:08.603554 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b3093-e7b0-45e4-a62a-dbcfa9a4476d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:08.603824 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b3093-e7b0-45e4-a62a-dbcfa9a4476d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:08.605073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b3093-e7b0-45e4-a62a-dbcfa9a4476d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:08.606549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b3093-e7b0-45e4-a62a-dbcfa9a4476d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:08.608217 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 19/43] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:08.609001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b3093-e7b0-45e4-a62a-dbcfa9a4476d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:08.704241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aa63f-97a7-478d-8ac5-ed117ec874c0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:08.742587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45e0cf-8b8c-4514-9eea-224053e913c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:08.743486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e0cf-8b8c-4514-9eea-224053e913c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:08.743766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e0cf-8b8c-4514-9eea-224053e913c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:08.744040 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e0cf-8b8c-4514-9eea-224053e913c8 None admin] PATH_INFO: `/v3/domains/default/users/7606b528dcd64b439b296d632d31e16c/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:08.746238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45e0cf-8b8c-4514-9eea-224053e913c8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7606b528dcd64b439b296d632d31e16c, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:08.747811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45e0cf-8b8c-4514-9eea-224053e913c8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:08.764372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 25/44] 10.222.0.30 () {58 vars in 1361 bytes} [Wed Jul 6 20:17:08 2022] PUT /identity/v3/domains/default/users/7606b528dcd64b439b296d632d31e16c/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:08.765243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45e0cf-8b8c-4514-9eea-224053e913c8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:08.805114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:08.821711 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:08.842386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b3093-e7b0-45e4-a62a-dbcfa9a4476d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:08.879176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e4111-fe4b-416c-b105-2a3456526fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:08.879981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e4111-fe4b-416c-b105-2a3456526fd5 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:08.880266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e4111-fe4b-416c-b105-2a3456526fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:08.880541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e4111-fe4b-416c-b105-2a3456526fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:08.881656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e4111-fe4b-416c-b105-2a3456526fd5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:08.883202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e4111-fe4b-416c-b105-2a3456526fd5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:08.892560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45e0cf-8b8c-4514-9eea-224053e913c8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:08.901296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 20/45] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Jul 6 20:17:08 2022] POST /identity/v3/roles => generated 223 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:08.935762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf9e23-6b66-4121-be89-6d5e99616daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:08.936556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf9e23-6b66-4121-be89-6d5e99616daf None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:08.936891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf9e23-6b66-4121-be89-6d5e99616daf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:08.937267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf9e23-6b66-4121-be89-6d5e99616daf None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:08.937987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf9e23-6b66-4121-be89-6d5e99616daf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:08.939481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf9e23-6b66-4121-be89-6d5e99616daf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:08.969743 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 26/46] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:17:08 2022] POST /identity/v3/projects => generated 312 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:10.759449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ce7c9-5d5c-492a-9c8b-7d5ec84c8d7e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:10.759987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ce7c9-5d5c-492a-9c8b-7d5ec84c8d7e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:10.759987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ce7c9-5d5c-492a-9c8b-7d5ec84c8d7e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:10.761395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 21/47] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:10.766742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99296-ac21-4bd7-8271-bee277a92de7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:10.767125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99296-ac21-4bd7-8271-bee277a92de7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:10.767309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99296-ac21-4bd7-8271-bee277a92de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:10.784465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6db99296-ac21-4bd7-8271-bee277a92de7 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:10.785693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6db99296-ac21-4bd7-8271-bee277a92de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:10.858408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 27/48] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:10.881626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ce7c9-5d5c-492a-9c8b-7d5ec84c8d7e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:10.964701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8674a-a04b-489a-ab00-69bf518dcadb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:10.964969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8674a-a04b-489a-ab00-69bf518dcadb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:10.965296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8674a-a04b-489a-ab00-69bf518dcadb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:10.966652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 28/49] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:17:10.971656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae90f79-88e1-42ac-a373-2679d33e2b32 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:10.971949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae90f79-88e1-42ac-a373-2679d33e2b32 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:10.972232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae90f79-88e1-42ac-a373-2679d33e2b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:10.987837 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ce7c9-5d5c-492a-9c8b-7d5ec84c8d7e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:10.989557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5ae90f79-88e1-42ac-a373-2679d33e2b32 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:10.990740 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5ae90f79-88e1-42ac-a373-2679d33e2b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:10.992738 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:11.024234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a10958-13a4-4bf0-9155-c1df536b249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:11.025000 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a10958-13a4-4bf0-9155-c1df536b249e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:11.025291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a10958-13a4-4bf0-9155-c1df536b249e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:11.025568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a10958-13a4-4bf0-9155-c1df536b249e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:11.036559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a10958-13a4-4bf0-9155-c1df536b249e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-34a10958-13a4-4bf0-9155-c1df536b249e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:11.044336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:11.045279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:11.046242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 22/50] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:17:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:11.051832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a10958-13a4-4bf0-9155-c1df536b249e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:11.055337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:11.057975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 29/51] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:11.080236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae90f79-88e1-42ac-a373-2679d33e2b32 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:11.153405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a10958-13a4-4bf0-9155-c1df536b249e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:11.183651 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae90f79-88e1-42ac-a373-2679d33e2b32 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:11.189270 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce9fdd-2632-421a-b661-113b3ea53472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:11.189946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce9fdd-2632-421a-b661-113b3ea53472 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:11.190226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce9fdd-2632-421a-b661-113b3ea53472 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:11.190886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce9fdd-2632-421a-b661-113b3ea53472 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:11.191654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce9fdd-2632-421a-b661-113b3ea53472 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:11.191961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce9fdd-2632-421a-b661-113b3ea53472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:11.194009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce9fdd-2632-421a-b661-113b3ea53472 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:11.202025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 23/52] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:11.207631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce9fdd-2632-421a-b661-113b3ea53472 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:11.216056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2cba8-a02f-4691-85cb-109468b5b0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:11.216868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2cba8-a02f-4691-85cb-109468b5b0ce None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:11.217191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2cba8-a02f-4691-85cb-109468b5b0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:11.217469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2cba8-a02f-4691-85cb-109468b5b0ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:11.218653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2cba8-a02f-4691-85cb-109468b5b0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:11.220119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2cba8-a02f-4691-85cb-109468b5b0ce None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:11.221788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 30/53] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:11.227176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2cba8-a02f-4691-85cb-109468b5b0ce None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:11.235390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:11.273154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:11.307166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce9fdd-2632-421a-b661-113b3ea53472 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:11.327935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2cba8-a02f-4691-85cb-109468b5b0ce None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:11.340728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c5d47-9274-46a5-97bb-1fda77f63beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:11.341615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c5d47-9274-46a5-97bb-1fda77f63beb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:11.341896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c5d47-9274-46a5-97bb-1fda77f63beb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:11.342245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c5d47-9274-46a5-97bb-1fda77f63beb None admin] PATH_INFO: `/v3/users/7606b528dcd64b439b296d632d31e16c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:11.343777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c5d47-9274-46a5-97bb-1fda77f63beb None admin] RBAC: Authorizing `identity:get_user(user_id=7606b528dcd64b439b296d632d31e16c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:11.345257 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c5d47-9274-46a5-97bb-1fda77f63beb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:11.347086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 24/54] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:11 2022] GET /identity/v3/users/7606b528dcd64b439b296d632d31e16c => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:11.352303 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c5d47-9274-46a5-97bb-1fda77f63beb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:11.365465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a49ae-04c6-4e77-a794-68b6c3bf88f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:11.366135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a49ae-04c6-4e77-a794-68b6c3bf88f4 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:11.366454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a49ae-04c6-4e77-a794-68b6c3bf88f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:11.366750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a49ae-04c6-4e77-a794-68b6c3bf88f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:11.367447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a49ae-04c6-4e77-a794-68b6c3bf88f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:11.368910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a49ae-04c6-4e77-a794-68b6c3bf88f4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:11.394734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 31/55] 10.222.0.30 () {60 vars in 1140 bytes} [Wed Jul 6 20:17:11 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:17:11.457080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c5d47-9274-46a5-97bb-1fda77f63beb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:11.496192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5ebe-c68d-4e3d-b2dc-79c056ee63d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:11.497025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5ebe-c68d-4e3d-b2dc-79c056ee63d3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:11.497334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5ebe-c68d-4e3d-b2dc-79c056ee63d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:11.497608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5ebe-c68d-4e3d-b2dc-79c056ee63d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:11.498950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac5ebe-c68d-4e3d-b2dc-79c056ee63d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:11.500469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac5ebe-c68d-4e3d-b2dc-79c056ee63d3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:11.502186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 25/56] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:11.508610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a49ae-04c6-4e77-a794-68b6c3bf88f4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:11.571719 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:11.614119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a49ae-04c6-4e77-a794-68b6c3bf88f4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:11.648987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79a0d7-ec61-47bb-88d4-36de841d3b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:11.649660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a0d7-ec61-47bb-88d4-36de841d3b96 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:11.649946 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a0d7-ec61-47bb-88d4-36de841d3b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:11.650227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a0d7-ec61-47bb-88d4-36de841d3b96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:11.651073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79a0d7-ec61-47bb-88d4-36de841d3b96 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.domain.id=default, user.id=7606b528dcd64b439b296d632d31e16c) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:11.651385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79a0d7-ec61-47bb-88d4-36de841d3b96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:11.652876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79a0d7-ec61-47bb-88d4-36de841d3b96 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:11.658950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 32/57] 10.222.0.30 () {56 vars in 1322 bytes} [Wed Jul 6 20:17:11 2022] GET /identity/v3/role_assignments?user.id=7606b528dcd64b439b296d632d31e16c&scope.domain.id=default&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:13.426739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc407dda-d823-47f5-96f7-ae0b069e3c8e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:13.427563 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc407dda-d823-47f5-96f7-ae0b069e3c8e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:13.427668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc407dda-d823-47f5-96f7-ae0b069e3c8e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:13.429863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 26/58] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:13.436092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1fc0d-6aed-438f-8f85-d43a184b3287 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:13.436770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1fc0d-6aed-438f-8f85-d43a184b3287 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:13.437016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1fc0d-6aed-438f-8f85-d43a184b3287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:13.458686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-baa1fc0d-6aed-438f-8f85-d43a184b3287 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:13.459884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-baa1fc0d-6aed-438f-8f85-d43a184b3287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:13.535043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 33/59] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:13.560695 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc407dda-d823-47f5-96f7-ae0b069e3c8e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:13.563967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:13.667551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc407dda-d823-47f5-96f7-ae0b069e3c8e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:13.701700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a2ffb-fce2-44a9-a845-24389969ce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:13.702424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a2ffb-fce2-44a9-a845-24389969ce8b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:13.702703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a2ffb-fce2-44a9-a845-24389969ce8b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:13.702976 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a2ffb-fce2-44a9-a845-24389969ce8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:13.704153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a2ffb-fce2-44a9-a845-24389969ce8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:13.705626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a2ffb-fce2-44a9-a845-24389969ce8b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:13.707237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 27/60] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:13.714378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1fc0d-6aed-438f-8f85-d43a184b3287 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:13.776700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:13.827279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1fc0d-6aed-438f-8f85-d43a184b3287 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:13.862127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128a455-e872-46e5-bb61-24190050e2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:13.862792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128a455-e872-46e5-bb61-24190050e2d6 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:13.863069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128a455-e872-46e5-bb61-24190050e2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:13.863340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128a455-e872-46e5-bb61-24190050e2d6 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:13.864032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128a455-e872-46e5-bb61-24190050e2d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:13.865501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128a455-e872-46e5-bb61-24190050e2d6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:13.896047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 34/61] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:17:13 2022] POST /identity/v3/users => generated 275 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:17.087250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ec0a-baa9-48c5-b1c0-76c4c0b11710 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.088702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ec0a-baa9-48c5-b1c0-76c4c0b11710 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.089523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ec0a-baa9-48c5-b1c0-76c4c0b11710 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.091862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e614c04-e5c1-431d-a590-4b0e0bde539a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.092574 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e614c04-e5c1-431d-a590-4b0e0bde539a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.092918 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 28/62] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:17:17.093240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e614c04-e5c1-431d-a590-4b0e0bde539a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.095763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 35/63] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:17.097657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88a7a5-a426-4329-9ea3-6762c404515e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.098201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88a7a5-a426-4329-9ea3-6762c404515e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.098676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88a7a5-a426-4329-9ea3-6762c404515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.101478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a836-e78b-4aec-a460-291d5a883fb4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.102230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a836-e78b-4aec-a460-291d5a883fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.102914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a836-e78b-4aec-a460-291d5a883fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.126703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8e88a7a5-a426-4329-9ea3-6762c404515e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:17.129651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8e88a7a5-a426-4329-9ea3-6762c404515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:17.142462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-58c2a836-e78b-4aec-a460-291d5a883fb4 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:17.144363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58c2a836-e78b-4aec-a460-291d5a883fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:17.281509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:17.290793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 29/64] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:17.313063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 36/65] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:17.324065 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88a7a5-a426-4329-9ea3-6762c404515e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:17.340713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2a836-e78b-4aec-a460-291d5a883fb4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:17.425398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:17.486964 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2a836-e78b-4aec-a460-291d5a883fb4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:17.527584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88a7a5-a426-4329-9ea3-6762c404515e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:17.532151 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11b07a-5826-4b28-947c-b6e02ec41047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:17.533269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11b07a-5826-4b28-947c-b6e02ec41047 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.533767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11b07a-5826-4b28-947c-b6e02ec41047 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.534236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11b07a-5826-4b28-947c-b6e02ec41047 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.549128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11b07a-5826-4b28-947c-b6e02ec41047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6e11b07a-5826-4b28-947c-b6e02ec41047 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:17.559777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:17.560633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:17.561526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:17.562712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d7d91-b107-48a9-8227-a5935bf32e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:17.563537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d7d91-b107-48a9-8227-a5935bf32e76 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.563821 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d7d91-b107-48a9-8227-a5935bf32e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.564096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d7d91-b107-48a9-8227-a5935bf32e76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.564684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 37/66] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:17.566362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd1a47-ad5b-4e89-a14b-d06dcbb071c2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.566880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd1a47-ad5b-4e89-a14b-d06dcbb071c2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.567630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd1a47-ad5b-4e89-a14b-d06dcbb071c2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.569159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 38/67] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:17.570551 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd1a47-ad5b-4e89-a14b-d06dcbb071c2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:17.579381 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d7d91-b107-48a9-8227-a5935bf32e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7e3d7d91-b107-48a9-8227-a5935bf32e76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:17.588198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:17.589077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:17.590013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 30/68] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:17:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:17.591000 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18870293-d73e-4dd4-909a-81f907a6ea9f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.591436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18870293-d73e-4dd4-909a-81f907a6ea9f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.591901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18870293-d73e-4dd4-909a-81f907a6ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.609505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-18870293-d73e-4dd4-909a-81f907a6ea9f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:17.611111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-18870293-d73e-4dd4-909a-81f907a6ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:17.670880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:17.689119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 31/69] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:17.690231 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18870293-d73e-4dd4-909a-81f907a6ea9f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:17.697692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:17.700431 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd1a47-ad5b-4e89-a14b-d06dcbb071c2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:17.740862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e766602-2cbb-4bdb-8732-a1ee57ce4f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:17.741984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e766602-2cbb-4bdb-8732-a1ee57ce4f2e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.742335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e766602-2cbb-4bdb-8732-a1ee57ce4f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.742703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e766602-2cbb-4bdb-8732-a1ee57ce4f2e None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.743544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e766602-2cbb-4bdb-8732-a1ee57ce4f2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:17.743924 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e766602-2cbb-4bdb-8732-a1ee57ce4f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:17.746390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e766602-2cbb-4bdb-8732-a1ee57ce4f2e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:17.757341 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 39/70] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:17.758524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e766602-2cbb-4bdb-8732-a1ee57ce4f2e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:17.818503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18870293-d73e-4dd4-909a-81f907a6ea9f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:17.854852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78efac-df02-4573-9625-562dc087648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:17.855460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78efac-df02-4573-9625-562dc087648d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.855747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78efac-df02-4573-9625-562dc087648d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.856024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78efac-df02-4573-9625-562dc087648d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.856791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78efac-df02-4573-9625-562dc087648d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:17.857132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78efac-df02-4573-9625-562dc087648d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:17.858528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78efac-df02-4573-9625-562dc087648d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:17.866532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 32/71] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:17:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:17.867585 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78efac-df02-4573-9625-562dc087648d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:17.878920 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e766602-2cbb-4bdb-8732-a1ee57ce4f2e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:17.916609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ec4b-20dd-4db7-bf86-0a587a9e68e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:17.917462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ec4b-20dd-4db7-bf86-0a587a9e68e3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.917749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ec4b-20dd-4db7-bf86-0a587a9e68e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.918074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ec4b-20dd-4db7-bf86-0a587a9e68e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.925304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:17.928542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6ec4b-20dd-4db7-bf86-0a587a9e68e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-fba6ec4b-20dd-4db7-bf86-0a587a9e68e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:17.936340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:17.937400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:17.938324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 40/72] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:17.939093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de0b4b-332b-4e60-806f-183d059e94e3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:17.939093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de0b4b-332b-4e60-806f-183d059e94e3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:17.939513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de0b4b-332b-4e60-806f-183d059e94e3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:17.940547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 41/73] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:17.941268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de0b4b-332b-4e60-806f-183d059e94e3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:17.964539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:17.980034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78efac-df02-4573-9625-562dc087648d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:18.014862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99bf12-2934-4b30-a9bc-8f505527e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:18.015727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99bf12-2934-4b30-a9bc-8f505527e134 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.016011 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99bf12-2934-4b30-a9bc-8f505527e134 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.016287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99bf12-2934-4b30-a9bc-8f505527e134 None admin] PATH_INFO: `/v3/users/7606b528dcd64b439b296d632d31e16c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.017551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99bf12-2934-4b30-a9bc-8f505527e134 None admin] RBAC: Authorizing `identity:get_user(user_id=7606b528dcd64b439b296d632d31e16c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:18.019020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99bf12-2934-4b30-a9bc-8f505527e134 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:18.020723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 33/74] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:17 2022] GET /identity/v3/users/7606b528dcd64b439b296d632d31e16c => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:18.021908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380fdaa-a60c-4630-bae0-4305d5ea2dd7 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.022196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380fdaa-a60c-4630-bae0-4305d5ea2dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.022472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380fdaa-a60c-4630-bae0-4305d5ea2dd7 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.024414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 34/75] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:18.025040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380fdaa-a60c-4630-bae0-4305d5ea2dd7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:18.049601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de0b4b-332b-4e60-806f-183d059e94e3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:18.085205 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195835b-3523-46fb-9a79-60ecba4b5c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:18.086093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195835b-3523-46fb-9a79-60ecba4b5c55 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.086379 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195835b-3523-46fb-9a79-60ecba4b5c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.086658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195835b-3523-46fb-9a79-60ecba4b5c55 None admin] PATH_INFO: `/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.099758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195835b-3523-46fb-9a79-60ecba4b5c55 None admin] RBAC: Authorizing `identity:get_user(user_id=14f59e7f0e4d4ba5b71ec440051ccf12)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:18.101418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195835b-3523-46fb-9a79-60ecba4b5c55 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:18.103086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 42/76] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:17 2022] GET /identity/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:18.104247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764ac5-b8d8-4203-9b64-4d3c40a6eb6d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.104562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764ac5-b8d8-4203-9b64-4d3c40a6eb6d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.104812 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764ac5-b8d8-4203-9b64-4d3c40a6eb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.121842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b2764ac5-b8d8-4203-9b64-4d3c40a6eb6d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:18.122958 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b2764ac5-b8d8-4203-9b64-4d3c40a6eb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:18.130082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380fdaa-a60c-4630-bae0-4305d5ea2dd7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:18.150225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:18.164113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb898-5f40-4bef-8c5c-67c84ca477de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:18.164782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb898-5f40-4bef-8c5c-67c84ca477de None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.165091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb898-5f40-4bef-8c5c-67c84ca477de None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.165372 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb898-5f40-4bef-8c5c-67c84ca477de None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.166226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb898-5f40-4bef-8c5c-67c84ca477de None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:18.166549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb898-5f40-4bef-8c5c-67c84ca477de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:18.167926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb898-5f40-4bef-8c5c-67c84ca477de None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:18.175807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 35/77] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:18.176582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb898-5f40-4bef-8c5c-67c84ca477de None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:18.192675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 43/78] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:18.194115 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb87e4-691d-4c90-89c5-85770144afec None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.194434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb87e4-691d-4c90-89c5-85770144afec None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.194724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb87e4-691d-4c90-89c5-85770144afec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.211196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c2cb87e4-691d-4c90-89c5-85770144afec None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:18.212377 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c2cb87e4-691d-4c90-89c5-85770144afec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:18.214710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:18.281290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 44/79] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:18.282211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb87e4-691d-4c90-89c5-85770144afec None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:18.292590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb898-5f40-4bef-8c5c-67c84ca477de None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:18.325859 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d9279-e7f0-4c69-b328-16639c476b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:18.326513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d9279-e7f0-4c69-b328-16639c476b5a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.326794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d9279-e7f0-4c69-b328-16639c476b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.327069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d9279-e7f0-4c69-b328-16639c476b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.374979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:18.387927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb87e4-691d-4c90-89c5-85770144afec None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:18.393457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d9279-e7f0-4c69-b328-16639c476b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:18.395208 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d9279-e7f0-4c69-b328-16639c476b5a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:18.426107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9324e3-bfa9-4f2a-96e4-b0f151218017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:18.426763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9324e3-bfa9-4f2a-96e4-b0f151218017 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.427046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9324e3-bfa9-4f2a-96e4-b0f151218017 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.427324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9324e3-bfa9-4f2a-96e4-b0f151218017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.435442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:18.493933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9324e3-bfa9-4f2a-96e4-b0f151218017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:18.495410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9324e3-bfa9-4f2a-96e4-b0f151218017 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:18.496750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 36/80] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:18.497626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d9279-e7f0-4c69-b328-16639c476b5a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:18.574862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:18.593259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d9279-e7f0-4c69-b328-16639c476b5a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:18.596289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 45/81] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:18.597144 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9324e3-bfa9-4f2a-96e4-b0f151218017 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:18.626288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb816b12-6128-45be-845c-0ecf035ad86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:18.627104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb816b12-6128-45be-845c-0ecf035ad86c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.627391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb816b12-6128-45be-845c-0ecf035ad86c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.627673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb816b12-6128-45be-845c-0ecf035ad86c None admin] PATH_INFO: `/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.628866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb816b12-6128-45be-845c-0ecf035ad86c None admin] RBAC: Authorizing `identity:get_user(user_id=14f59e7f0e4d4ba5b71ec440051ccf12)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:18.630431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb816b12-6128-45be-845c-0ecf035ad86c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:18.632451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 37/82] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:18 2022] GET /identity/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:18.633232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb816b12-6128-45be-845c-0ecf035ad86c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:18.642097 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:18.700670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9324e3-bfa9-4f2a-96e4-b0f151218017 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:18.728306 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb816b12-6128-45be-845c-0ecf035ad86c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:18.733034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67065097-2d60-4fc0-adad-30b497881aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:18.733828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67065097-2d60-4fc0-adad-30b497881aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.734103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67065097-2d60-4fc0-adad-30b497881aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.734370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67065097-2d60-4fc0-adad-30b497881aa3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.735539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67065097-2d60-4fc0-adad-30b497881aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:18.737016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67065097-2d60-4fc0-adad-30b497881aa3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:18.738643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 46/83] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:18.740567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67065097-2d60-4fc0-adad-30b497881aa3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:18.763227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cd1e2-c2ce-4615-b268-3aa66df6ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:18.764015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cd1e2-c2ce-4615-b268-3aa66df6ad68 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.764294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cd1e2-c2ce-4615-b268-3aa66df6ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.764569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cd1e2-c2ce-4615-b268-3aa66df6ad68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.774584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cd1e2-c2ce-4615-b268-3aa66df6ad68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8a8cd1e2-c2ce-4615-b268-3aa66df6ad68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:18.782185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:18.783034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:18.783786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 38/84] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:18.784405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cd1e2-c2ce-4615-b268-3aa66df6ad68 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:18.796251 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:18.845931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67065097-2d60-4fc0-adad-30b497881aa3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:18.853132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:18.880748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8277641-8229-4f32-b25b-5da9a04cff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:18.880902 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cd1e2-c2ce-4615-b268-3aa66df6ad68 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:18.881913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8277641-8229-4f32-b25b-5da9a04cff71 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.882197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8277641-8229-4f32-b25b-5da9a04cff71 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.882473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8277641-8229-4f32-b25b-5da9a04cff71 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.883683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8277641-8229-4f32-b25b-5da9a04cff71 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:18.885255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8277641-8229-4f32-b25b-5da9a04cff71 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:18.886974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 47/85] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:18 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:18.887737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8277641-8229-4f32-b25b-5da9a04cff71 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:18.917018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43243c0c-9e07-4adf-bbc6-4469cba65c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:18.917889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43243c0c-9e07-4adf-bbc6-4469cba65c79 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:18.918165 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43243c0c-9e07-4adf-bbc6-4469cba65c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:18.918433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43243c0c-9e07-4adf-bbc6-4469cba65c79 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:18.919622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43243c0c-9e07-4adf-bbc6-4469cba65c79 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:18.921097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43243c0c-9e07-4adf-bbc6-4469cba65c79 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:18.922792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 39/86] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:18 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:18.923521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43243c0c-9e07-4adf-bbc6-4469cba65c79 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:18.988750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8277641-8229-4f32-b25b-5da9a04cff71 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:19.008425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:19.023495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e39a7-2029-4574-b5e7-b1706bbb8768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:19.024152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e39a7-2029-4574-b5e7-b1706bbb8768 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:19.024431 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e39a7-2029-4574-b5e7-b1706bbb8768 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:19.024701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e39a7-2029-4574-b5e7-b1706bbb8768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:19.031460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43243c0c-9e07-4adf-bbc6-4469cba65c79 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:19.064534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33088fc3-7b1d-4026-a595-7463fb6cc8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:19.065225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:19.065339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33088fc3-7b1d-4026-a595-7463fb6cc8ce None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:19.065517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33088fc3-7b1d-4026-a595-7463fb6cc8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:19.065794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33088fc3-7b1d-4026-a595-7463fb6cc8ce None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:19.066612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33088fc3-7b1d-4026-a595-7463fb6cc8ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:19.068192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33088fc3-7b1d-4026-a595-7463fb6cc8ce None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:19.092240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e39a7-2029-4574-b5e7-b1706bbb8768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:19.093569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 40/87] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:17:18 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:19.093750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e39a7-2029-4574-b5e7-b1706bbb8768 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:19.094388 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33088fc3-7b1d-4026-a595-7463fb6cc8ce None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:19.207936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33088fc3-7b1d-4026-a595-7463fb6cc8ce None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:19.220358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 48/88] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:19.220358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e39a7-2029-4574-b5e7-b1706bbb8768 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:19.253743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d8813-4159-4dd1-80b5-d2ef51467126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:19.254432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d8813-4159-4dd1-80b5-d2ef51467126 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:19.254713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d8813-4159-4dd1-80b5-d2ef51467126 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:19.254987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d8813-4159-4dd1-80b5-d2ef51467126 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:19.255916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d8813-4159-4dd1-80b5-d2ef51467126 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:19.256436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d8813-4159-4dd1-80b5-d2ef51467126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:19.257888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d8813-4159-4dd1-80b5-d2ef51467126 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:19.260174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:19.274031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 41/89] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:19.275581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d8813-4159-4dd1-80b5-d2ef51467126 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:19.297395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:19.331653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e39a7-2029-4574-b5e7-b1706bbb8768 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:19.378300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353d237-1ec8-4913-ae22-aeda2f2352e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:19.379221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353d237-1ec8-4913-ae22-aeda2f2352e2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:19.379654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353d237-1ec8-4913-ae22-aeda2f2352e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:19.379932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353d237-1ec8-4913-ae22-aeda2f2352e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:19.381879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353d237-1ec8-4913-ae22-aeda2f2352e2 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=c3623463132749bc9f5eb4efee71c513, user.id=7606b528dcd64b439b296d632d31e16c) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:19.382367 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353d237-1ec8-4913-ae22-aeda2f2352e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:19.386101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353d237-1ec8-4913-ae22-aeda2f2352e2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:19.394598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 49/90] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:19 2022] GET /identity/v3/role_assignments?user.id=7606b528dcd64b439b296d632d31e16c&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:19.395444 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353d237-1ec8-4913-ae22-aeda2f2352e2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:19.413540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d8813-4159-4dd1-80b5-d2ef51467126 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:19.467671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84a3c-f7b6-4ac2-8351-15706c09cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:19.468896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84a3c-f7b6-4ac2-8351-15706c09cc31 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:19.469210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84a3c-f7b6-4ac2-8351-15706c09cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:19.469486 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84a3c-f7b6-4ac2-8351-15706c09cc31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:19.470424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84a3c-f7b6-4ac2-8351-15706c09cc31 None admin] RBAC: Adding query filter params (role.id=ce1cbac653a64c268855a459ce0aae34, scope.project.id=c3623463132749bc9f5eb4efee71c513, user.id=14f59e7f0e4d4ba5b71ec440051ccf12) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:19.472825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84a3c-f7b6-4ac2-8351-15706c09cc31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:19.477607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84a3c-f7b6-4ac2-8351-15706c09cc31 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:19.491571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 42/91] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:19 2022] GET /identity/v3/role_assignments?user.id=14f59e7f0e4d4ba5b71ec440051ccf12&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=ce1cbac653a64c268855a459ce0aae34 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:19.493292 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84a3c-f7b6-4ac2-8351-15706c09cc31 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:19.576500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353d237-1ec8-4913-ae22-aeda2f2352e2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:19.581252 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:19.638834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d1162-b50c-4cb8-b4b0-b2d8162546b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:19.640659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d1162-b50c-4cb8-b4b0-b2d8162546b1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:19.640659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d1162-b50c-4cb8-b4b0-b2d8162546b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:19.640659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d1162-b50c-4cb8-b4b0-b2d8162546b1 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:19.642808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d1162-b50c-4cb8-b4b0-b2d8162546b1 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:19.644320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d1162-b50c-4cb8-b4b0-b2d8162546b1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:19.646187 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 50/92] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:19 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:19.654092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d1162-b50c-4cb8-b4b0-b2d8162546b1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:19.661814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84a3c-f7b6-4ac2-8351-15706c09cc31 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:19.673359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:19.722079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f9eeb-f154-4bd9-881c-79048ea4b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:19.722890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f9eeb-f154-4bd9-881c-79048ea4b496 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:19.723170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f9eeb-f154-4bd9-881c-79048ea4b496 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:19.723444 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f9eeb-f154-4bd9-881c-79048ea4b496 None admin] PATH_INFO: `/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:19.725553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f9eeb-f154-4bd9-881c-79048ea4b496 None admin] RBAC: Authorizing `identity:get_user(user_id=14f59e7f0e4d4ba5b71ec440051ccf12)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:19.727057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f9eeb-f154-4bd9-881c-79048ea4b496 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:19.728919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 43/93] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:19 2022] GET /identity/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:19.734465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f9eeb-f154-4bd9-881c-79048ea4b496 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:19.835362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d1162-b50c-4cb8-b4b0-b2d8162546b1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:19.885527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f9eeb-f154-4bd9-881c-79048ea4b496 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:19.903273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff9160-82f6-494e-9e00-9611f5f0f866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:19.904056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9160-82f6-494e-9e00-9611f5f0f866 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:19.904402 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9160-82f6-494e-9e00-9611f5f0f866 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:19.904742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9160-82f6-494e-9e00-9611f5f0f866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:19.905713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff9160-82f6-494e-9e00-9611f5f0f866 None admin] RBAC: Adding query filter params (role.id=0997a26e1c354ef5b0c2730f761b47ed, scope.project.id=c3623463132749bc9f5eb4efee71c513, user.id=14f59e7f0e4d4ba5b71ec440051ccf12) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:19.906089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff9160-82f6-494e-9e00-9611f5f0f866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:19.907624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff9160-82f6-494e-9e00-9611f5f0f866 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:19.927213 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 51/94] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:19 2022] GET /identity/v3/role_assignments?user.id=14f59e7f0e4d4ba5b71ec440051ccf12&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:19.940420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:19.957204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f90f89-d7a2-4ee4-83fc-dc5ead5b98e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:19.958259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f90f89-d7a2-4ee4-83fc-dc5ead5b98e5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:19.958725 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f90f89-d7a2-4ee4-83fc-dc5ead5b98e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:19.959184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f90f89-d7a2-4ee4-83fc-dc5ead5b98e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:20.055996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f90f89-d7a2-4ee4-83fc-dc5ead5b98e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:20.057767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f90f89-d7a2-4ee4-83fc-dc5ead5b98e5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:20.198166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 44/95] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:17:20.204168 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff9160-82f6-494e-9e00-9611f5f0f866 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:20.302794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:20.340803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff9160-82f6-494e-9e00-9611f5f0f866 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:20.374584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ccedc-adab-481c-9204-4eb466054756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:20.375454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ccedc-adab-481c-9204-4eb466054756 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:20.375734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ccedc-adab-481c-9204-4eb466054756 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:20.376013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ccedc-adab-481c-9204-4eb466054756 None admin] PATH_INFO: `/v3/projects/90a452f99ab34fa9880994080530d2cc` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:20.377221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ccedc-adab-481c-9204-4eb466054756 None admin] RBAC: Authorizing `identity:get_project(project_id=90a452f99ab34fa9880994080530d2cc)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:20.378868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ccedc-adab-481c-9204-4eb466054756 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:20.380929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 52/96] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:20 2022] GET /identity/v3/projects/90a452f99ab34fa9880994080530d2cc => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:20.386924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f90f89-d7a2-4ee4-83fc-dc5ead5b98e5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:20.444085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:20.531439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f90f89-d7a2-4ee4-83fc-dc5ead5b98e5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:20.567088 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95862192-2b1d-4ac7-8c92-c9b70ffd8173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:20.568146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862192-2b1d-4ac7-8c92-c9b70ffd8173 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:20.568626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862192-2b1d-4ac7-8c92-c9b70ffd8173 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:20.569134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862192-2b1d-4ac7-8c92-c9b70ffd8173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:20.570207 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95862192-2b1d-4ac7-8c92-c9b70ffd8173 None admin] RBAC: Adding query filter params (role.id=0997a26e1c354ef5b0c2730f761b47ed, scope.project.id=90a452f99ab34fa9880994080530d2cc, user.id=14f59e7f0e4d4ba5b71ec440051ccf12) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:20.570709 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95862192-2b1d-4ac7-8c92-c9b70ffd8173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:20.572348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95862192-2b1d-4ac7-8c92-c9b70ffd8173 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:20.578791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 45/97] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:20 2022] GET /identity/v3/role_assignments?user.id=14f59e7f0e4d4ba5b71ec440051ccf12&scope.project.id=90a452f99ab34fa9880994080530d2cc&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:21.948857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be87715-d19a-44fe-b961-52f22674e286 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:21.949411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be87715-d19a-44fe-b961-52f22674e286 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:21.949922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be87715-d19a-44fe-b961-52f22674e286 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:21.952289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 53/98] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:21.958965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d2f68-f205-46f2-ac45-a9a540f7e2d6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:21.959465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d2f68-f205-46f2-ac45-a9a540f7e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:21.959536 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d2f68-f205-46f2-ac45-a9a540f7e2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:21.978448 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b77d2f68-f205-46f2-ac45-a9a540f7e2d6 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:21.979942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b77d2f68-f205-46f2-ac45-a9a540f7e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:22.055450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 46/99] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:22.094553 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be87715-d19a-44fe-b961-52f22674e286 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:22.155532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18383b2e-eb72-4be5-9a65-cbff8d84df99 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:22.156173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18383b2e-eb72-4be5-9a65-cbff8d84df99 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:22.156636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18383b2e-eb72-4be5-9a65-cbff8d84df99 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:22.158533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 47/100] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:22.164446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0968de-7eb6-485e-ab26-a55f0dbe6f55 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:22.165016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0968de-7eb6-485e-ab26-a55f0dbe6f55 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:22.165478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0968de-7eb6-485e-ab26-a55f0dbe6f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:22.198194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0c0968de-7eb6-485e-ab26-a55f0dbe6f55 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:22.201122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0c0968de-7eb6-485e-ab26-a55f0dbe6f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:22.237621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:22.291262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be87715-d19a-44fe-b961-52f22674e286 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:22.332800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 48/101] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:22.339905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dad485-6334-4fc1-bb2f-e433f731cfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:22.340941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dad485-6334-4fc1-bb2f-e433f731cfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:22.341452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dad485-6334-4fc1-bb2f-e433f731cfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:22.341947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dad485-6334-4fc1-bb2f-e433f731cfe1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:22.343290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dad485-6334-4fc1-bb2f-e433f731cfe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:22.345120 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dad485-6334-4fc1-bb2f-e433f731cfe1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:22.347003 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 54/102] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:22.353061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0968de-7eb6-485e-ab26-a55f0dbe6f55 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:22.364175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dad485-6334-4fc1-bb2f-e433f731cfe1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:22.375913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:22.547519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dad485-6334-4fc1-bb2f-e433f731cfe1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:22.551579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0968de-7eb6-485e-ab26-a55f0dbe6f55 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:22.610543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccae5f-37cc-400d-b6cc-2af27df3d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:22.611181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccae5f-37cc-400d-b6cc-2af27df3d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:22.611464 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccae5f-37cc-400d-b6cc-2af27df3d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:22.611738 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccae5f-37cc-400d-b6cc-2af27df3d1c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:22.623468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccae5f-37cc-400d-b6cc-2af27df3d1c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:22.625894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0d6e5-d249-4fab-bc8f-8eccd51e1705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:22.626814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0d6e5-d249-4fab-bc8f-8eccd51e1705 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:22.627296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0d6e5-d249-4fab-bc8f-8eccd51e1705 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:22.627768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0d6e5-d249-4fab-bc8f-8eccd51e1705 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:22.628701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0d6e5-d249-4fab-bc8f-8eccd51e1705 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:22.630479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0d6e5-d249-4fab-bc8f-8eccd51e1705 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-98ccae5f-37cc-400d-b6cc-2af27df3d1c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:22.638517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:22.639588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 55/103] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:17:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:17:22.640554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ecd9-9d99-4a23-b08b-d63760caaa66 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:22.641461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ecd9-9d99-4a23-b08b-d63760caaa66 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:22.641461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ecd9-9d99-4a23-b08b-d63760caaa66 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:22.641461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 56/104] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:22.642225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ecd9-9d99-4a23-b08b-d63760caaa66 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:22.695715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 49/105] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:17:22 2022] POST /identity/v3/projects => generated 302 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:22.697401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93d07-17e2-42e4-9e0d-4252c09a94dd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:22.697819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93d07-17e2-42e4-9e0d-4252c09a94dd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:22.698222 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93d07-17e2-42e4-9e0d-4252c09a94dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:22.717390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:22.740688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fdf93d07-17e2-42e4-9e0d-4252c09a94dd None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:22.742338 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fdf93d07-17e2-42e4-9e0d-4252c09a94dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:22.742790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:22.826383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ecd9-9d99-4a23-b08b-d63760caaa66 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:22.889048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 50/106] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:22.890363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828008bc-baba-43db-b0c7-a5a16bc61aee None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:22.890652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828008bc-baba-43db-b0c7-a5a16bc61aee None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:22.890932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828008bc-baba-43db-b0c7-a5a16bc61aee None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:22.892281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 51/107] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:22.900454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c434ec4-f273-4012-a0c6-3ce4ac46bc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:22.901184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434ec4-f273-4012-a0c6-3ce4ac46bc86 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:22.901520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434ec4-f273-4012-a0c6-3ce4ac46bc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:22.901800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434ec4-f273-4012-a0c6-3ce4ac46bc86 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:22.902188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2176-28ae-4585-90e8-8999074944c8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:22.902480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2176-28ae-4585-90e8-8999074944c8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:22.902623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c434ec4-f273-4012-a0c6-3ce4ac46bc86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:22.902761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2176-28ae-4585-90e8-8999074944c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:22.902941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c434ec4-f273-4012-a0c6-3ce4ac46bc86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:22.904436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c434ec4-f273-4012-a0c6-3ce4ac46bc86 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:22.913921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 57/108] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:17:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:22.919652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c434ec4-f273-4012-a0c6-3ce4ac46bc86 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:22.924878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5aee2176-28ae-4585-90e8-8999074944c8 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:22.926202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5aee2176-28ae-4585-90e8-8999074944c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:23.010339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 52/109] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:23.011568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee2176-28ae-4585-90e8-8999074944c8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:23.052026 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c434ec4-f273-4012-a0c6-3ce4ac46bc86 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:23.082196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:23.091875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21103db-3e29-4a7f-8402-ecf77646377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:23.092861 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21103db-3e29-4a7f-8402-ecf77646377d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.093346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21103db-3e29-4a7f-8402-ecf77646377d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.093632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21103db-3e29-4a7f-8402-ecf77646377d None admin] PATH_INFO: `/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.094894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21103db-3e29-4a7f-8402-ecf77646377d None admin] RBAC: Authorizing `identity:get_user(user_id=14f59e7f0e4d4ba5b71ec440051ccf12)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:23.096365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21103db-3e29-4a7f-8402-ecf77646377d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:23.098249 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 58/110] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:22 2022] GET /identity/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:23.099025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21103db-3e29-4a7f-8402-ecf77646377d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:23.110002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:23.153728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee2176-28ae-4585-90e8-8999074944c8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:23.188457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3fc49-130b-4dc8-b87c-e594af41566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:23.189592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3fc49-130b-4dc8-b87c-e594af41566b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.190014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3fc49-130b-4dc8-b87c-e594af41566b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.190425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3fc49-130b-4dc8-b87c-e594af41566b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.202532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3fc49-130b-4dc8-b87c-e594af41566b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-18d3fc49-130b-4dc8-b87c-e594af41566b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:23.210537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:23.211571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:23.212499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:23.214429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 53/111] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:23.215323 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21103db-3e29-4a7f-8402-ecf77646377d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:23.215495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3fc49-130b-4dc8-b87c-e594af41566b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:23.253363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bdaa5-5d4d-4794-a44b-350310a3c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:23.254196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bdaa5-5d4d-4794-a44b-350310a3c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.254531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bdaa5-5d4d-4794-a44b-350310a3c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.254819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bdaa5-5d4d-4794-a44b-350310a3c6f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.267248 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bdaa5-5d4d-4794-a44b-350310a3c6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f92bdaa5-5d4d-4794-a44b-350310a3c6f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:23.275583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:23.276627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:23.277538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 59/112] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:23.278161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bdaa5-5d4d-4794-a44b-350310a3c6f4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:23.325310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3fc49-130b-4dc8-b87c-e594af41566b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:23.343074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:23.349706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:23.362204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9c4d8-6ede-4255-a2b4-802173274db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:23.363119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c4d8-6ede-4255-a2b4-802173274db6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.363408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c4d8-6ede-4255-a2b4-802173274db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.363692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c4d8-6ede-4255-a2b4-802173274db6 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.365384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9c4d8-6ede-4255-a2b4-802173274db6 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:23.367636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9c4d8-6ede-4255-a2b4-802173274db6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:23.369618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 54/113] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:23 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:23.370652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737e12f-e138-46cd-9a1a-3726bf6c71b8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.370940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737e12f-e138-46cd-9a1a-3726bf6c71b8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.371221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737e12f-e138-46cd-9a1a-3726bf6c71b8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.376727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 55/114] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:23.376727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737e12f-e138-46cd-9a1a-3726bf6c71b8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:23.399929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bdaa5-5d4d-4794-a44b-350310a3c6f4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:23.442651 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1582b-b04b-46ba-91c9-04af63323f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:23.443322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1582b-b04b-46ba-91c9-04af63323f64 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.443609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1582b-b04b-46ba-91c9-04af63323f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.443886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1582b-b04b-46ba-91c9-04af63323f64 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.444715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1582b-b04b-46ba-91c9-04af63323f64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:23.445029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1582b-b04b-46ba-91c9-04af63323f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:23.446441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1582b-b04b-46ba-91c9-04af63323f64 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:23.455180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 60/115] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:23.460818 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911e2fc-1b7a-4605-a6e6-120d252af299 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.461134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911e2fc-1b7a-4605-a6e6-120d252af299 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.461417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911e2fc-1b7a-4605-a6e6-120d252af299 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.462843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 61/116] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:23.465968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911e2fc-1b7a-4605-a6e6-120d252af299 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:23.482609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737e12f-e138-46cd-9a1a-3726bf6c71b8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:23.520684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f629b0-5fb5-4d84-bd55-19a4ee7cc383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:23.521427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f629b0-5fb5-4d84-bd55-19a4ee7cc383 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.521718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f629b0-5fb5-4d84-bd55-19a4ee7cc383 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.521996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f629b0-5fb5-4d84-bd55-19a4ee7cc383 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.522839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f629b0-5fb5-4d84-bd55-19a4ee7cc383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:23.523142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f629b0-5fb5-4d84-bd55-19a4ee7cc383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:23.524552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f629b0-5fb5-4d84-bd55-19a4ee7cc383 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:23.533373 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 56/117] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:23.539092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075ca0d-f984-4fa0-80e1-3ad490328394 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.539390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075ca0d-f984-4fa0-80e1-3ad490328394 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.539672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075ca0d-f984-4fa0-80e1-3ad490328394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.559055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0075ca0d-f984-4fa0-80e1-3ad490328394 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:23.560427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0075ca0d-f984-4fa0-80e1-3ad490328394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:23.577703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911e2fc-1b7a-4605-a6e6-120d252af299 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:23.596992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:23.614076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:23.618460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b7150-b1bb-41dc-a6c5-ee5815f221e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:23.619380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b7150-b1bb-41dc-a6c5-ee5815f221e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.619703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b7150-b1bb-41dc-a6c5-ee5815f221e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.620504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b7150-b1bb-41dc-a6c5-ee5815f221e8 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513/users/14f59e7f0e4d4ba5b71ec440051ccf12/roles/ce1cbac653a64c268855a459ce0aae34` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.622710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b7150-b1bb-41dc-a6c5-ee5815f221e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3623463132749bc9f5eb4efee71c513, user_id=14f59e7f0e4d4ba5b71ec440051ccf12, role_id=ce1cbac653a64c268855a459ce0aae34)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:23.624440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b7150-b1bb-41dc-a6c5-ee5815f221e8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:23.639341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 57/118] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:23.640634 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 62/119] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:17:23 2022] PUT /identity/v3/projects/c3623463132749bc9f5eb4efee71c513/users/14f59e7f0e4d4ba5b71ec440051ccf12/roles/ce1cbac653a64c268855a459ce0aae34 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:23.640893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075ca0d-f984-4fa0-80e1-3ad490328394 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:23.654568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d51c8-e9c2-404f-9de3-e53ce3868b93 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.654836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d51c8-e9c2-404f-9de3-e53ce3868b93 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.655228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d51c8-e9c2-404f-9de3-e53ce3868b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.685122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-502d51c8-e9c2-404f-9de3-e53ce3868b93 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:23.686790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-502d51c8-e9c2-404f-9de3-e53ce3868b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:23.775815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075ca0d-f984-4fa0-80e1-3ad490328394 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:23.788983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 63/120] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:23.788983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d51c8-e9c2-404f-9de3-e53ce3868b93 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:23.842775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08ff95-1fb6-4510-8824-31c52e80a566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:23.843674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08ff95-1fb6-4510-8824-31c52e80a566 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.843985 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08ff95-1fb6-4510-8824-31c52e80a566 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.844540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08ff95-1fb6-4510-8824-31c52e80a566 None admin] PATH_INFO: `/v3/users/7a7d071ec00f413dbbd10e161b8d5396` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.863076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08ff95-1fb6-4510-8824-31c52e80a566 None admin] RBAC: Authorizing `identity:get_user(user_id=7a7d071ec00f413dbbd10e161b8d5396)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:23.863901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08ff95-1fb6-4510-8824-31c52e80a566 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:23.865996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 58/121] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:23 2022] GET /identity/v3/users/7a7d071ec00f413dbbd10e161b8d5396 => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:23.866738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08ff95-1fb6-4510-8824-31c52e80a566 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:23.912307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:23.914537 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d51c8-e9c2-404f-9de3-e53ce3868b93 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:23.928883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:23.966903 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b314cc5-d4a9-4100-b046-78c03a08dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:23.968124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b314cc5-d4a9-4100-b046-78c03a08dd0a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:23.968413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b314cc5-d4a9-4100-b046-78c03a08dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:23.968691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b314cc5-d4a9-4100-b046-78c03a08dd0a None admin] PATH_INFO: `/v3/users/7606b528dcd64b439b296d632d31e16c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:23.970567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b314cc5-d4a9-4100-b046-78c03a08dd0a None admin] RBAC: Authorizing `identity:get_user(user_id=7606b528dcd64b439b296d632d31e16c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:23.972374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b314cc5-d4a9-4100-b046-78c03a08dd0a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:23.972986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08ff95-1fb6-4510-8824-31c52e80a566 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:23.974161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 64/122] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:23 2022] GET /identity/v3/users/7606b528dcd64b439b296d632d31e16c => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:23.975271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b314cc5-d4a9-4100-b046-78c03a08dd0a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:24.009109 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaacbe-97fb-41cc-b8cd-630cd3d22521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:24.010053 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaacbe-97fb-41cc-b8cd-630cd3d22521 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:24.010451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaacbe-97fb-41cc-b8cd-630cd3d22521 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:24.010980 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaacbe-97fb-41cc-b8cd-630cd3d22521 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:24.021813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaacbe-97fb-41cc-b8cd-630cd3d22521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6bcaacbe-97fb-41cc-b8cd-630cd3d22521 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:24.029614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:24.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:24.031466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 59/123] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:24.032119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaacbe-97fb-41cc-b8cd-630cd3d22521 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:24.114162 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b314cc5-d4a9-4100-b046-78c03a08dd0a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:24.145799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaacbe-97fb-41cc-b8cd-630cd3d22521 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:24.150063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051878a6-e984-4aed-8aaa-c5713005b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:24.151104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051878a6-e984-4aed-8aaa-c5713005b6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:24.151576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051878a6-e984-4aed-8aaa-c5713005b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:24.152036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051878a6-e984-4aed-8aaa-c5713005b6b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:24.157376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:24.164154 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051878a6-e984-4aed-8aaa-c5713005b6b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-051878a6-e984-4aed-8aaa-c5713005b6b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:24.172721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:24.173721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:24.174481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:24.177002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 65/124] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:24.182821 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051878a6-e984-4aed-8aaa-c5713005b6b9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:24.185435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8059d-23e7-4624-a557-d89086255fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:24.186092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8059d-23e7-4624-a557-d89086255fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:24.186375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8059d-23e7-4624-a557-d89086255fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:24.186652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8059d-23e7-4624-a557-d89086255fd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:24.220976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:24.257040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8059d-23e7-4624-a557-d89086255fd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:24.258546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8059d-23e7-4624-a557-d89086255fd8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:24.293390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051878a6-e984-4aed-8aaa-c5713005b6b9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:24.330170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f1fb6-1b80-4568-9a83-0f13feeb0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:24.331336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f1fb6-1b80-4568-9a83-0f13feeb0da4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:24.331803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f1fb6-1b80-4568-9a83-0f13feeb0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:24.332262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f1fb6-1b80-4568-9a83-0f13feeb0da4 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:24.333660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f1fb6-1b80-4568-9a83-0f13feeb0da4 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:24.335465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f1fb6-1b80-4568-9a83-0f13feeb0da4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:24.337521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 66/125] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:24 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:24.338623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f1fb6-1b80-4568-9a83-0f13feeb0da4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:24.360262 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 60/126] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:24.364945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8059d-23e7-4624-a557-d89086255fd8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:24.365468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:24.453069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f1fb6-1b80-4568-9a83-0f13feeb0da4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:24.455959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:24.462323 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8059d-23e7-4624-a557-d89086255fd8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:24.493238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda51f37-8208-4726-9fe8-385ac04a7c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:24.494310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda51f37-8208-4726-9fe8-385ac04a7c4b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:24.494791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda51f37-8208-4726-9fe8-385ac04a7c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:24.495268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda51f37-8208-4726-9fe8-385ac04a7c4b None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:24.496233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda51f37-8208-4726-9fe8-385ac04a7c4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:24.496900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496e9c8-5e81-4088-b8f0-3b14e27c067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:24.497294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda51f37-8208-4726-9fe8-385ac04a7c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:24.497622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e9c8-5e81-4088-b8f0-3b14e27c067a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:24.497906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e9c8-5e81-4088-b8f0-3b14e27c067a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:24.498232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e9c8-5e81-4088-b8f0-3b14e27c067a None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:24.498996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496e9c8-5e81-4088-b8f0-3b14e27c067a None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:24.499304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496e9c8-5e81-4088-b8f0-3b14e27c067a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:24.499984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda51f37-8208-4726-9fe8-385ac04a7c4b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:24.500664 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496e9c8-5e81-4088-b8f0-3b14e27c067a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:24.509882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 61/127] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:24.510255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 67/128] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:24.510676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496e9c8-5e81-4088-b8f0-3b14e27c067a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:24.511524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda51f37-8208-4726-9fe8-385ac04a7c4b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:24.585177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:24.631765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496e9c8-5e81-4088-b8f0-3b14e27c067a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:24.639512 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda51f37-8208-4726-9fe8-385ac04a7c4b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:24.668324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1d799-95e7-492b-a062-1107ec87a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:24.669548 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1d799-95e7-492b-a062-1107ec87a995 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:24.669836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1d799-95e7-492b-a062-1107ec87a995 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:24.670118 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1d799-95e7-492b-a062-1107ec87a995 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513/users/7606b528dcd64b439b296d632d31e16c/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:24.672238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1d799-95e7-492b-a062-1107ec87a995 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3623463132749bc9f5eb4efee71c513, user_id=7606b528dcd64b439b296d632d31e16c, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:24.673837 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1d799-95e7-492b-a062-1107ec87a995 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:24.678828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be50371-ceeb-4cee-a0da-9af6522c3845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:24.680093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50371-ceeb-4cee-a0da-9af6522c3845 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:24.680654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50371-ceeb-4cee-a0da-9af6522c3845 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:24.681136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50371-ceeb-4cee-a0da-9af6522c3845 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:24.682662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be50371-ceeb-4cee-a0da-9af6522c3845 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:24.684407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be50371-ceeb-4cee-a0da-9af6522c3845 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:24.686400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 68/129] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:24 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:24.687384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be50371-ceeb-4cee-a0da-9af6522c3845 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:24.698744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 62/130] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:17:24 2022] PUT /identity/v3/projects/c3623463132749bc9f5eb4efee71c513/users/7606b528dcd64b439b296d632d31e16c/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:24.699977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1d799-95e7-492b-a062-1107ec87a995 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:24.749249 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:24.826774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be50371-ceeb-4cee-a0da-9af6522c3845 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:24.865355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c62cf-aba1-40a1-91cd-73c9fe83110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:24.866791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c62cf-aba1-40a1-91cd-73c9fe83110c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:24.867291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c62cf-aba1-40a1-91cd-73c9fe83110c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:24.867762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c62cf-aba1-40a1-91cd-73c9fe83110c None admin] PATH_INFO: `/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:24.870059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c62cf-aba1-40a1-91cd-73c9fe83110c None admin] RBAC: Authorizing `identity:get_user(user_id=14f59e7f0e4d4ba5b71ec440051ccf12)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:24.871750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c62cf-aba1-40a1-91cd-73c9fe83110c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:24.873892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 69/131] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:24 2022] GET /identity/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:24.874936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c62cf-aba1-40a1-91cd-73c9fe83110c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:24.932806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1d799-95e7-492b-a062-1107ec87a995 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:24.961992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:24.974835 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d194d-81ae-45b3-8557-ca4feeed18a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:24.976018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d194d-81ae-45b3-8557-ca4feeed18a0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:24.976454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d194d-81ae-45b3-8557-ca4feeed18a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:24.976884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d194d-81ae-45b3-8557-ca4feeed18a0 None admin] PATH_INFO: `/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:24.978478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d194d-81ae-45b3-8557-ca4feeed18a0 None admin] RBAC: Authorizing `identity:get_user(user_id=14f59e7f0e4d4ba5b71ec440051ccf12)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:24.980167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d194d-81ae-45b3-8557-ca4feeed18a0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:24.982594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 63/132] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:24 2022] GET /identity/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:24.983591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d194d-81ae-45b3-8557-ca4feeed18a0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:24.997457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c62cf-aba1-40a1-91cd-73c9fe83110c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:24.999150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:25.036231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4ec2f-db6e-48ac-919f-653f24753975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:25.037004 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4ec2f-db6e-48ac-919f-653f24753975 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:25.037512 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4ec2f-db6e-48ac-919f-653f24753975 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:25.037963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4ec2f-db6e-48ac-919f-653f24753975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:25.039171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4ec2f-db6e-48ac-919f-653f24753975 None admin] RBAC: Adding query filter params (role.id=11fdf15006214f86a22373ac8ad9db18, scope.project.id=c3623463132749bc9f5eb4efee71c513, user.id=7a7d071ec00f413dbbd10e161b8d5396) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:25.039654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4ec2f-db6e-48ac-919f-653f24753975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:25.041411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4ec2f-db6e-48ac-919f-653f24753975 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:25.047593 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 70/133] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:24 2022] GET /identity/v3/role_assignments?user.id=7a7d071ec00f413dbbd10e161b8d5396&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=11fdf15006214f86a22373ac8ad9db18 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:25.048596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4ec2f-db6e-48ac-919f-653f24753975 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:25.139545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d194d-81ae-45b3-8557-ca4feeed18a0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:25.214728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3d4f5-70e4-443c-a676-4a275f502ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:25.215615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d4f5-70e4-443c-a676-4a275f502ffe None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:25.215892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d4f5-70e4-443c-a676-4a275f502ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:25.216165 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d4f5-70e4-443c-a676-4a275f502ffe None admin] PATH_INFO: `/v3/projects/90a452f99ab34fa9880994080530d2cc` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:25.218310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3d4f5-70e4-443c-a676-4a275f502ffe None admin] RBAC: Authorizing `identity:get_project(project_id=90a452f99ab34fa9880994080530d2cc)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:25.219804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3d4f5-70e4-443c-a676-4a275f502ffe None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:25.224317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 64/134] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:24 2022] GET /identity/v3/projects/90a452f99ab34fa9880994080530d2cc => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:25.228444 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4ec2f-db6e-48ac-919f-653f24753975 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:25.231658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581a0c-a5ae-49ef-af8e-f5ea027164ba None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:25.231951 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581a0c-a5ae-49ef-af8e-f5ea027164ba None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:25.232227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581a0c-a5ae-49ef-af8e-f5ea027164ba None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:25.233686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 65/135] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:25.237325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e581a0c-a5ae-49ef-af8e-f5ea027164ba None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:25.286547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edad22-7b2b-46bb-9f78-483060ff8d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:25.287428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edad22-7b2b-46bb-9f78-483060ff8d08 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:25.287716 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edad22-7b2b-46bb-9f78-483060ff8d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:25.287997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edad22-7b2b-46bb-9f78-483060ff8d08 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:25.289304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edad22-7b2b-46bb-9f78-483060ff8d08 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:25.293068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edad22-7b2b-46bb-9f78-483060ff8d08 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:25.293068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 71/136] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:25 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:25.294150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854249e5-3ca9-414e-9081-2910294e6ebd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:25.294442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854249e5-3ca9-414e-9081-2910294e6ebd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:25.294722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854249e5-3ca9-414e-9081-2910294e6ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:25.329886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-854249e5-3ca9-414e-9081-2910294e6ebd None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:25.331110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-854249e5-3ca9-414e-9081-2910294e6ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:25.337352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:25.380021 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:25.422981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e581a0c-a5ae-49ef-af8e-f5ea027164ba None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:25.430417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 72/137] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:25.431273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854249e5-3ca9-414e-9081-2910294e6ebd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:25.542260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b21545-2ba8-4fe2-89f8-f534837327db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:25.543184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b21545-2ba8-4fe2-89f8-f534837327db None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:25.543466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b21545-2ba8-4fe2-89f8-f534837327db None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:25.543744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b21545-2ba8-4fe2-89f8-f534837327db None admin] PATH_INFO: `/v3/projects/90a452f99ab34fa9880994080530d2cc/users/14f59e7f0e4d4ba5b71ec440051ccf12/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:25.545769 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b21545-2ba8-4fe2-89f8-f534837327db None admin] RBAC: Authorizing `identity:create_grant(project_id=90a452f99ab34fa9880994080530d2cc, user_id=14f59e7f0e4d4ba5b71ec440051ccf12, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:25.547223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b21545-2ba8-4fe2-89f8-f534837327db None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:25.577117 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 66/138] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:17:25 2022] PUT /identity/v3/projects/90a452f99ab34fa9880994080530d2cc/users/14f59e7f0e4d4ba5b71ec440051ccf12/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:25.577860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b21545-2ba8-4fe2-89f8-f534837327db None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:25.593083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854249e5-3ca9-414e-9081-2910294e6ebd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:25.684076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f451b-0be0-4343-8941-cb9f0fad5842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:25.684912 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f451b-0be0-4343-8941-cb9f0fad5842 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:25.685226 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f451b-0be0-4343-8941-cb9f0fad5842 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:25.686410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f451b-0be0-4343-8941-cb9f0fad5842 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513/users/14f59e7f0e4d4ba5b71ec440051ccf12/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:25.689187 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f451b-0be0-4343-8941-cb9f0fad5842 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3623463132749bc9f5eb4efee71c513, user_id=14f59e7f0e4d4ba5b71ec440051ccf12, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:25.690670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f451b-0be0-4343-8941-cb9f0fad5842 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:25.722573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 73/139] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:17:25 2022] PUT /identity/v3/projects/c3623463132749bc9f5eb4efee71c513/users/14f59e7f0e4d4ba5b71ec440051ccf12/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:25.801231 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b21545-2ba8-4fe2-89f8-f534837327db None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:25.841581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:25.862599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da4764-0a4e-47ec-abae-bc26aac8de77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:25.863430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4764-0a4e-47ec-abae-bc26aac8de77 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:25.863717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4764-0a4e-47ec-abae-bc26aac8de77 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:25.863993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4764-0a4e-47ec-abae-bc26aac8de77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:25.870007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da4764-0a4e-47ec-abae-bc26aac8de77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:25.871524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da4764-0a4e-47ec-abae-bc26aac8de77 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:25.873310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 67/140] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:25.879231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f451b-0be0-4343-8941-cb9f0fad5842 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:25.914292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:25.996833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f451b-0be0-4343-8941-cb9f0fad5842 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:26.033492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27433b1c-ee80-4e02-b1ee-c3ea8a87e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:26.034177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433b1c-ee80-4e02-b1ee-c3ea8a87e33d None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:26.034456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433b1c-ee80-4e02-b1ee-c3ea8a87e33d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:26.034730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433b1c-ee80-4e02-b1ee-c3ea8a87e33d None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:26.035467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27433b1c-ee80-4e02-b1ee-c3ea8a87e33d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:26.036934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27433b1c-ee80-4e02-b1ee-c3ea8a87e33d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:26.060240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 74/141] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:17:25 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:26.104146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417ed4-6808-4e8e-a8fb-6d0d8652de04 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:26.104464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417ed4-6808-4e8e-a8fb-6d0d8652de04 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:26.104718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417ed4-6808-4e8e-a8fb-6d0d8652de04 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:26.106289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 68/142] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:26.111700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd066a-d8bf-46e3-aa7c-8c682ea35091 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:26.112062 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd066a-d8bf-46e3-aa7c-8c682ea35091 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:26.112263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd066a-d8bf-46e3-aa7c-8c682ea35091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:26.134139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e4cd066a-d8bf-46e3-aa7c-8c682ea35091 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:26.135382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e4cd066a-d8bf-46e3-aa7c-8c682ea35091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:26.223782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 75/143] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:26.275128 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c417ed4-6808-4e8e-a8fb-6d0d8652de04 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:26.415283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c417ed4-6808-4e8e-a8fb-6d0d8652de04 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:26.451742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98f817-48ba-4c21-8d10-f48a974ee062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:26.452617 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f817-48ba-4c21-8d10-f48a974ee062 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:26.452908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f817-48ba-4c21-8d10-f48a974ee062 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:26.453224 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f817-48ba-4c21-8d10-f48a974ee062 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:26.466016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98f817-48ba-4c21-8d10-f48a974ee062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1a98f817-48ba-4c21-8d10-f48a974ee062 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:26.475283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:26.476194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:26.476995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 69/144] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:17:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:26.486346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd066a-d8bf-46e3-aa7c-8c682ea35091 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:26.509339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:26.624791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd066a-d8bf-46e3-aa7c-8c682ea35091 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:26.726642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f8a30-fff7-4e7f-bb1d-db138aaed374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:26.727338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f8a30-fff7-4e7f-bb1d-db138aaed374 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:26.727619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f8a30-fff7-4e7f-bb1d-db138aaed374 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:26.727889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f8a30-fff7-4e7f-bb1d-db138aaed374 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:26.728650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f8a30-fff7-4e7f-bb1d-db138aaed374 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:26.728983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f8a30-fff7-4e7f-bb1d-db138aaed374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:26.730356 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f8a30-fff7-4e7f-bb1d-db138aaed374 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:26.763265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 76/145] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:17:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:26.771538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98f817-48ba-4c21-8d10-f48a974ee062 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:26.876756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:26.973450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98f817-48ba-4c21-8d10-f48a974ee062 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:27.050288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da021083-4d5d-4871-a768-0a45a86cfc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:27.051192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021083-4d5d-4871-a768-0a45a86cfc36 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:27.051474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021083-4d5d-4871-a768-0a45a86cfc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:27.051745 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021083-4d5d-4871-a768-0a45a86cfc36 None admin] PATH_INFO: `/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:27.053085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da021083-4d5d-4871-a768-0a45a86cfc36 None admin] RBAC: Authorizing `identity:get_user(user_id=14f59e7f0e4d4ba5b71ec440051ccf12)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:27.054605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da021083-4d5d-4871-a768-0a45a86cfc36 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:27.057261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 70/146] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:26 2022] GET /identity/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:27.061723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f8a30-fff7-4e7f-bb1d-db138aaed374 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:27.210244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:27.272896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f8a30-fff7-4e7f-bb1d-db138aaed374 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:27.349917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90091e7a-6848-4f79-a054-b1ecb457fd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:27.350618 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90091e7a-6848-4f79-a054-b1ecb457fd65 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:27.350939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90091e7a-6848-4f79-a054-b1ecb457fd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:27.351216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90091e7a-6848-4f79-a054-b1ecb457fd65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:27.405018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356c43-6867-4c1b-91a5-550794324085 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:27.405555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356c43-6867-4c1b-91a5-550794324085 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:27.405555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356c43-6867-4c1b-91a5-550794324085 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:27.406940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 71/147] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:27.414711 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff3d04-e007-42b6-8942-4d9f9ba80a84 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:27.415007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff3d04-e007-42b6-8942-4d9f9ba80a84 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:27.415267 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff3d04-e007-42b6-8942-4d9f9ba80a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:27.448188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9aff3d04-e007-42b6-8942-4d9f9ba80a84 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:27.450119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9aff3d04-e007-42b6-8942-4d9f9ba80a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:27.470686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90091e7a-6848-4f79-a054-b1ecb457fd65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:27.472098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90091e7a-6848-4f79-a054-b1ecb457fd65 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:27.546780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:27.592321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 77/148] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:27.601977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90091e7a-6848-4f79-a054-b1ecb457fd65 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:27.661243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 72/149] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:27.694113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff3d04-e007-42b6-8942-4d9f9ba80a84 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:27.744376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90091e7a-6848-4f79-a054-b1ecb457fd65 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:27.775136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:27.798504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a905e-d7de-4230-a8ae-3297703d5d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:27.799650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a905e-d7de-4230-a8ae-3297703d5d02 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:27.800105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a905e-d7de-4230-a8ae-3297703d5d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:27.800517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a905e-d7de-4230-a8ae-3297703d5d02 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:27.805787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a905e-d7de-4230-a8ae-3297703d5d02 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:27.807476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a905e-d7de-4230-a8ae-3297703d5d02 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:27.809454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 78/150] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:27 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:27.822066 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a905e-d7de-4230-a8ae-3297703d5d02 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:27.865432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff3d04-e007-42b6-8942-4d9f9ba80a84 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:27.892491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:27.921697 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec02c55-aa19-441e-a769-044cc252ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:27.922521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec02c55-aa19-441e-a769-044cc252ea6b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:27.922799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec02c55-aa19-441e-a769-044cc252ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:27.923068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec02c55-aa19-441e-a769-044cc252ea6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:27.938110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec02c55-aa19-441e-a769-044cc252ea6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-aec02c55-aa19-441e-a769-044cc252ea6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:27.949892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:27.950990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:27.951967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 73/151] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:27.959512 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec02c55-aa19-441e-a769-044cc252ea6b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:27.980172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a905e-d7de-4230-a8ae-3297703d5d02 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:28.019916 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a53f14-b217-4149-b47e-219155f3e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:28.020509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53f14-b217-4149-b47e-219155f3e33d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:28.020792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53f14-b217-4149-b47e-219155f3e33d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:28.021630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53f14-b217-4149-b47e-219155f3e33d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:28.022502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a53f14-b217-4149-b47e-219155f3e33d None admin] RBAC: Adding query filter params (role.id=ce1cbac653a64c268855a459ce0aae34, scope.project.id=c3623463132749bc9f5eb4efee71c513, user.id=14f59e7f0e4d4ba5b71ec440051ccf12) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:28.022899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a53f14-b217-4149-b47e-219155f3e33d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:28.024379 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a53f14-b217-4149-b47e-219155f3e33d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:28.036889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 79/152] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:27 2022] GET /identity/v3/role_assignments?user.id=14f59e7f0e4d4ba5b71ec440051ccf12&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=ce1cbac653a64c268855a459ce0aae34 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:28.038757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122622-5636-46d1-9cd6-7d70d09d6c80 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:28.039248 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122622-5636-46d1-9cd6-7d70d09d6c80 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:28.039711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122622-5636-46d1-9cd6-7d70d09d6c80 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:28.041193 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 80/153] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:28.052116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8c974-2433-4027-9384-756830e6570e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:28.052776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8c974-2433-4027-9384-756830e6570e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:28.053291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8c974-2433-4027-9384-756830e6570e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:28.084174 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-58f8c974-2433-4027-9384-756830e6570e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:28.085882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58f8c974-2433-4027-9384-756830e6570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:28.192412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 81/154] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:28.203163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec02c55-aa19-441e-a769-044cc252ea6b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:28.217368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:28.234190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8c974-2433-4027-9384-756830e6570e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:28.283220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8eeee8-859b-45a3-8ca2-2d5f6aa97d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:28.283817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eeee8-859b-45a3-8ca2-2d5f6aa97d35 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:28.284091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eeee8-859b-45a3-8ca2-2d5f6aa97d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:28.285168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eeee8-859b-45a3-8ca2-2d5f6aa97d35 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:28.285938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eeee8-859b-45a3-8ca2-2d5f6aa97d35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:28.286244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eeee8-859b-45a3-8ca2-2d5f6aa97d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:28.287645 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eeee8-859b-45a3-8ca2-2d5f6aa97d35 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:28.305701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 74/155] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:28.311743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8eeee8-859b-45a3-8ca2-2d5f6aa97d35 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:28.313885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:28.433521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8eeee8-859b-45a3-8ca2-2d5f6aa97d35 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:28.451903 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8c974-2433-4027-9384-756830e6570e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:28.479590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb012e-15f4-41da-b267-3e9b0c72e47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:28.480942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb012e-15f4-41da-b267-3e9b0c72e47b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:28.482156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb012e-15f4-41da-b267-3e9b0c72e47b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:28.482792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb012e-15f4-41da-b267-3e9b0c72e47b None admin] PATH_INFO: `/v3/users/7606b528dcd64b439b296d632d31e16c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:28.485589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb012e-15f4-41da-b267-3e9b0c72e47b None admin] RBAC: Authorizing `identity:get_user(user_id=7606b528dcd64b439b296d632d31e16c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:28.487432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb012e-15f4-41da-b267-3e9b0c72e47b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:28.491743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 75/156] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:28 2022] GET /identity/v3/users/7606b528dcd64b439b296d632d31e16c => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:28.499974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb012e-15f4-41da-b267-3e9b0c72e47b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:28.535443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d94cbf-6da8-4a7d-8d0f-cea0d2db636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:28.536613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d94cbf-6da8-4a7d-8d0f-cea0d2db636e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:28.538410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d94cbf-6da8-4a7d-8d0f-cea0d2db636e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:28.538885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d94cbf-6da8-4a7d-8d0f-cea0d2db636e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:28.568993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d94cbf-6da8-4a7d-8d0f-cea0d2db636e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:28.569707 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-40d94cbf-6da8-4a7d-8d0f-cea0d2db636e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:28.574567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:28.575904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:28.576764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:28.579139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 82/157] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:28.603004 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d94cbf-6da8-4a7d-8d0f-cea0d2db636e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:28.644946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb012e-15f4-41da-b267-3e9b0c72e47b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:28.691168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a2b4a-3447-47e5-bcf2-d7cccfe35655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:28.691874 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a2b4a-3447-47e5-bcf2-d7cccfe35655 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:28.692154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a2b4a-3447-47e5-bcf2-d7cccfe35655 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:28.692429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a2b4a-3447-47e5-bcf2-d7cccfe35655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:28.848472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a2b4a-3447-47e5-bcf2-d7cccfe35655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:28.850129 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a2b4a-3447-47e5-bcf2-d7cccfe35655 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:28.867453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:28.880074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d94cbf-6da8-4a7d-8d0f-cea0d2db636e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:28.923525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:28.958617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0906625-0b2b-4c87-b634-77e7eaf6476b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:28.959305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0906625-0b2b-4c87-b634-77e7eaf6476b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:28.959592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0906625-0b2b-4c87-b634-77e7eaf6476b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:28.959867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0906625-0b2b-4c87-b634-77e7eaf6476b None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:28.960760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0906625-0b2b-4c87-b634-77e7eaf6476b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:28.961095 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0906625-0b2b-4c87-b634-77e7eaf6476b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:28.962498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0906625-0b2b-4c87-b634-77e7eaf6476b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:28.980441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 83/158] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:28.986673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0906625-0b2b-4c87-b634-77e7eaf6476b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:29.044772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 76/159] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:29.051351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a2b4a-3447-47e5-bcf2-d7cccfe35655 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:29.227919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0906625-0b2b-4c87-b634-77e7eaf6476b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:29.239098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a2b4a-3447-47e5-bcf2-d7cccfe35655 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:29.312712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7cbf7-29cb-4cb2-8c77-58ae60c3c61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:29.313728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7cbf7-29cb-4cb2-8c77-58ae60c3c61b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:29.314107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7cbf7-29cb-4cb2-8c77-58ae60c3c61b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:29.314456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7cbf7-29cb-4cb2-8c77-58ae60c3c61b None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:29.315669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7cbf7-29cb-4cb2-8c77-58ae60c3c61b None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:29.317148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7cbf7-29cb-4cb2-8c77-58ae60c3c61b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:29.323611 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 77/160] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:29 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:29.323769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3dfc0-7e4a-4de1-8748-d10680d6d2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:29.323769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3dfc0-7e4a-4de1-8748-d10680d6d2cd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:29.323769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3dfc0-7e4a-4de1-8748-d10680d6d2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:29.323769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3dfc0-7e4a-4de1-8748-d10680d6d2cd None admin] PATH_INFO: `/v3/users/7a7d071ec00f413dbbd10e161b8d5396` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:29.324883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3dfc0-7e4a-4de1-8748-d10680d6d2cd None admin] RBAC: Authorizing `identity:get_user(user_id=7a7d071ec00f413dbbd10e161b8d5396)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:29.325671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7cbf7-29cb-4cb2-8c77-58ae60c3c61b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:29.326368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3dfc0-7e4a-4de1-8748-d10680d6d2cd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:29.328011 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 84/161] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:28 2022] GET /identity/v3/users/7a7d071ec00f413dbbd10e161b8d5396 => generated 289 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:29.333809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3dfc0-7e4a-4de1-8748-d10680d6d2cd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:29.334249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:29.385337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:29.484941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3dfc0-7e4a-4de1-8748-d10680d6d2cd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:29.544086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562bf54-6071-4e6b-8c07-0de2b5e93228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:29.545009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562bf54-6071-4e6b-8c07-0de2b5e93228 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:29.545291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562bf54-6071-4e6b-8c07-0de2b5e93228 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:29.545560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562bf54-6071-4e6b-8c07-0de2b5e93228 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:29.546865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562bf54-6071-4e6b-8c07-0de2b5e93228 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:29.548357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562bf54-6071-4e6b-8c07-0de2b5e93228 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:29.550128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 85/162] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:29 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:29.551365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c456c4-c323-45b1-b2c2-906811537c2b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:29.551638 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c456c4-c323-45b1-b2c2-906811537c2b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:29.551909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c456c4-c323-45b1-b2c2-906811537c2b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:29.553146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 86/163] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:29.560988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7cbf7-29cb-4cb2-8c77-58ae60c3c61b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:29.573985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c456c4-c323-45b1-b2c2-906811537c2b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:29.610239 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300c0d9-b09b-44ea-9e5f-08fec7fbe278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:29.611029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c0d9-b09b-44ea-9e5f-08fec7fbe278 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:29.611311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c0d9-b09b-44ea-9e5f-08fec7fbe278 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:29.611584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c0d9-b09b-44ea-9e5f-08fec7fbe278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:29.612440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300c0d9-b09b-44ea-9e5f-08fec7fbe278 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=c3623463132749bc9f5eb4efee71c513, user.id=7606b528dcd64b439b296d632d31e16c) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:29.612752 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300c0d9-b09b-44ea-9e5f-08fec7fbe278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:29.614260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300c0d9-b09b-44ea-9e5f-08fec7fbe278 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:29.634921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 78/164] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:29 2022] GET /identity/v3/role_assignments?user.id=7606b528dcd64b439b296d632d31e16c&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:29.636191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6342cb-bd87-4163-87cb-7848ad7811d9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:29.636473 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6342cb-bd87-4163-87cb-7848ad7811d9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:29.636746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6342cb-bd87-4163-87cb-7848ad7811d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:29.670126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2c6342cb-bd87-4163-87cb-7848ad7811d9 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:29.671351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2c6342cb-bd87-4163-87cb-7848ad7811d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:29.714482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:29.734454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c456c4-c323-45b1-b2c2-906811537c2b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:29.779811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7269db2-a9f9-4f37-afd1-a126590eeac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:29.781552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7269db2-a9f9-4f37-afd1-a126590eeac1 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:29.782114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7269db2-a9f9-4f37-afd1-a126590eeac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:29.782607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7269db2-a9f9-4f37-afd1-a126590eeac1 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513/users/7a7d071ec00f413dbbd10e161b8d5396/roles/11fdf15006214f86a22373ac8ad9db18` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:29.785101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7269db2-a9f9-4f37-afd1-a126590eeac1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3623463132749bc9f5eb4efee71c513, user_id=7a7d071ec00f413dbbd10e161b8d5396, role_id=11fdf15006214f86a22373ac8ad9db18)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:29.786887 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7269db2-a9f9-4f37-afd1-a126590eeac1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:29.816574 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 87/165] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:17:29 2022] PUT /identity/v3/projects/c3623463132749bc9f5eb4efee71c513/users/7a7d071ec00f413dbbd10e161b8d5396/roles/11fdf15006214f86a22373ac8ad9db18 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:29.818506 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359bc5e-b917-479e-a722-08ffa56d507f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:29.819062 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359bc5e-b917-479e-a722-08ffa56d507f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:29.819667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359bc5e-b917-479e-a722-08ffa56d507f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:29.821587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 88/166] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:29.829401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c0ebc-7257-470a-b6b3-7c62549ed086 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:29.829401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c0ebc-7257-470a-b6b3-7c62549ed086 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:29.829797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c0ebc-7257-470a-b6b3-7c62549ed086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:29.840735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:29.864273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 79/167] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:29.865137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-816c0ebc-7257-470a-b6b3-7c62549ed086 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:29.866549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-816c0ebc-7257-470a-b6b3-7c62549ed086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:29.902109 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6342cb-bd87-4163-87cb-7848ad7811d9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:29.993198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 89/168] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:30.022889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c0ebc-7257-470a-b6b3-7c62549ed086 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:30.127426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:30.150087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c0ebc-7257-470a-b6b3-7c62549ed086 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:30.155777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6342cb-bd87-4163-87cb-7848ad7811d9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:30.196724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f48858-8d20-480a-988c-65effc9e6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:30.197639 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f48858-8d20-480a-988c-65effc9e6f38 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:30.197921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f48858-8d20-480a-988c-65effc9e6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:30.198192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f48858-8d20-480a-988c-65effc9e6f38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:30.226698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f48858-8d20-480a-988c-65effc9e6f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:30.233767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5759e-f6ee-465e-a143-146e89e13a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:30.234575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5759e-f6ee-465e-a143-146e89e13a82 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:30.234858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5759e-f6ee-465e-a143-146e89e13a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:30.235136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5759e-f6ee-465e-a143-146e89e13a82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-50f48858-8d20-480a-988c-65effc9e6f38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:30.239891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:30.240757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:30.241702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:30.251870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 90/169] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:30.257628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5759e-f6ee-465e-a143-146e89e13a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:30.262813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f48858-8d20-480a-988c-65effc9e6f38 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d9c5759e-f6ee-465e-a143-146e89e13a82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:30.277123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:30.278046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:30.278811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:30.281288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 80/170] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:30.287161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5759e-f6ee-465e-a143-146e89e13a82 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:30.403727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f48858-8d20-480a-988c-65effc9e6f38 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:30.459113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa0932-cbdb-4cb8-8f64-1ba56ef8afd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:30.459809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa0932-cbdb-4cb8-8f64-1ba56ef8afd8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:30.460095 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa0932-cbdb-4cb8-8f64-1ba56ef8afd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:30.460449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa0932-cbdb-4cb8-8f64-1ba56ef8afd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:30.461407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa0932-cbdb-4cb8-8f64-1ba56ef8afd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:30.461734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa0932-cbdb-4cb8-8f64-1ba56ef8afd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:30.463253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa0932-cbdb-4cb8-8f64-1ba56ef8afd8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:30.472714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 91/171] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:30.474201 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a48f4-3b0d-48ff-94a0-1956ccef54b9 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:30.474524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a48f4-3b0d-48ff-94a0-1956ccef54b9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:30.474902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a48f4-3b0d-48ff-94a0-1956ccef54b9 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:30.476463 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 92/172] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:30.481787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a48f4-3b0d-48ff-94a0-1956ccef54b9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:30.490184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:30.492098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:30.534939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5759e-f6ee-465e-a143-146e89e13a82 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:30.579750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89575f-9c6f-41cd-8c15-544d20fe174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:30.580524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89575f-9c6f-41cd-8c15-544d20fe174b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:30.580814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89575f-9c6f-41cd-8c15-544d20fe174b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:30.581126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89575f-9c6f-41cd-8c15-544d20fe174b None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:30.582080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89575f-9c6f-41cd-8c15-544d20fe174b None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:30.582390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89575f-9c6f-41cd-8c15-544d20fe174b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:30.584859 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89575f-9c6f-41cd-8c15-544d20fe174b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:30.605276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 81/173] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:30.607249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec004338-747d-4371-b648-65710a42f1b6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:30.607760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec004338-747d-4371-b648-65710a42f1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:30.608040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec004338-747d-4371-b648-65710a42f1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:30.643597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ec004338-747d-4371-b648-65710a42f1b6 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:30.644796 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ec004338-747d-4371-b648-65710a42f1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:30.671492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a48f4-3b0d-48ff-94a0-1956ccef54b9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:30.711702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852e663-8b1a-4c9c-b24e-06ac4c3d7efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:30.712596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852e663-8b1a-4c9c-b24e-06ac4c3d7efc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:30.712875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852e663-8b1a-4c9c-b24e-06ac4c3d7efc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:30.713171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852e663-8b1a-4c9c-b24e-06ac4c3d7efc None admin] PATH_INFO: `/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:30.715781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852e663-8b1a-4c9c-b24e-06ac4c3d7efc None admin] RBAC: Authorizing `identity:get_user(user_id=14f59e7f0e4d4ba5b71ec440051ccf12)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:30.717274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852e663-8b1a-4c9c-b24e-06ac4c3d7efc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:30.719177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 93/174] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:30 2022] GET /identity/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:30.719735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852e663-8b1a-4c9c-b24e-06ac4c3d7efc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:30.728385 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 82/175] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:30.730225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3d1ec-17b6-4b69-96de-4fb8e7cb7274 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:30.730700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3d1ec-17b6-4b69-96de-4fb8e7cb7274 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:30.731255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3d1ec-17b6-4b69-96de-4fb8e7cb7274 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:30.736701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 83/176] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:30.737738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3d1ec-17b6-4b69-96de-4fb8e7cb7274 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:30.791035 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:30.835768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:30.854475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3d1ec-17b6-4b69-96de-4fb8e7cb7274 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:30.859171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852e663-8b1a-4c9c-b24e-06ac4c3d7efc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:30.894583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507ced3-d8c9-4be0-9011-f9a7bef6f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:30.895694 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ced3-d8c9-4be0-9011-f9a7bef6f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:30.896160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ced3-d8c9-4be0-9011-f9a7bef6f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:30.896612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ced3-d8c9-4be0-9011-f9a7bef6f3e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:30.904443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce397a46-1421-48d5-b4d1-b64c5ceb3cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:30.905673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce397a46-1421-48d5-b4d1-b64c5ceb3cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:30.906165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce397a46-1421-48d5-b4d1-b64c5ceb3cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:30.906624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce397a46-1421-48d5-b4d1-b64c5ceb3cf8 None admin] PATH_INFO: `/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:30.908098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce397a46-1421-48d5-b4d1-b64c5ceb3cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=14f59e7f0e4d4ba5b71ec440051ccf12)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:30.909777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce397a46-1421-48d5-b4d1-b64c5ceb3cf8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:30.911703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 94/177] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:30 2022] GET /identity/v3/users/14f59e7f0e4d4ba5b71ec440051ccf12 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:30.913262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b3087-3f8f-401c-bede-8f8928ae7b7b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:30.913785 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b3087-3f8f-401c-bede-8f8928ae7b7b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:30.914266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b3087-3f8f-401c-bede-8f8928ae7b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:30.931758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3b4b3087-3f8f-401c-bede-8f8928ae7b7b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:30.933307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3b4b3087-3f8f-401c-bede-8f8928ae7b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:30.984321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507ced3-d8c9-4be0-9011-f9a7bef6f3e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:30.986243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507ced3-d8c9-4be0-9011-f9a7bef6f3e4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:31.005758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 95/178] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:31.013173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b3087-3f8f-401c-bede-8f8928ae7b7b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:31.059441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:31.089836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:31.113382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 84/179] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:31.114656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507ced3-d8c9-4be0-9011-f9a7bef6f3e4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:31.130767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b3087-3f8f-401c-bede-8f8928ae7b7b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:31.167673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee255ea1-7ed5-41e2-a562-9ce5f9fbc29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:31.168492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee255ea1-7ed5-41e2-a562-9ce5f9fbc29d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:31.168751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee255ea1-7ed5-41e2-a562-9ce5f9fbc29d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:31.169057 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee255ea1-7ed5-41e2-a562-9ce5f9fbc29d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:31.180359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee255ea1-7ed5-41e2-a562-9ce5f9fbc29d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ee255ea1-7ed5-41e2-a562-9ce5f9fbc29d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:31.188112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:31.189005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:31.189805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 96/180] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:17:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:31.190465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee255ea1-7ed5-41e2-a562-9ce5f9fbc29d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:31.236906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507ced3-d8c9-4be0-9011-f9a7bef6f3e4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:31.272424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b39d9-283e-448e-9ca5-a02c8d9c9b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:31.273409 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b39d9-283e-448e-9ca5-a02c8d9c9b52 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:31.273840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b39d9-283e-448e-9ca5-a02c8d9c9b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:31.274114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b39d9-283e-448e-9ca5-a02c8d9c9b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:31.294331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:31.301139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee255ea1-7ed5-41e2-a562-9ce5f9fbc29d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:31.332238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:31.339559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f18f16-074f-4c59-8373-8f1467d3d532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:31.340484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18f16-074f-4c59-8373-8f1467d3d532 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:31.340798 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18f16-074f-4c59-8373-8f1467d3d532 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:31.341173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18f16-074f-4c59-8373-8f1467d3d532 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:31.343451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b39d9-283e-448e-9ca5-a02c8d9c9b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:31.344945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b39d9-283e-448e-9ca5-a02c8d9c9b52 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:31.351839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f18f16-074f-4c59-8373-8f1467d3d532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e5f18f16-074f-4c59-8373-8f1467d3d532 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:31.360484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:31.361601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 97/181] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:17:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:31.367796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774aa73-31ad-47ba-a9b4-7c8a2c492fe1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:31.368835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774aa73-31ad-47ba-a9b4-7c8a2c492fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:31.368835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774aa73-31ad-47ba-a9b4-7c8a2c492fe1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:31.368835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 98/182] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:31.369507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774aa73-31ad-47ba-a9b4-7c8a2c492fe1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:31.461568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 85/183] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:31.465968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b39d9-283e-448e-9ca5-a02c8d9c9b52 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:31.480229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774aa73-31ad-47ba-a9b4-7c8a2c492fe1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:31.520366 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:31.524484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cfddd-7e72-4fe0-bc77-6dd1791eb972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:31.525397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cfddd-7e72-4fe0-bc77-6dd1791eb972 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:31.525696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cfddd-7e72-4fe0-bc77-6dd1791eb972 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:31.525954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cfddd-7e72-4fe0-bc77-6dd1791eb972 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:31.527339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cfddd-7e72-4fe0-bc77-6dd1791eb972 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:31.528842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cfddd-7e72-4fe0-bc77-6dd1791eb972 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:31.535650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 99/184] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:31 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:31.536308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cfddd-7e72-4fe0-bc77-6dd1791eb972 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:31.575233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b39d9-283e-448e-9ca5-a02c8d9c9b52 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:31.598642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:31.612193 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31f299-5115-4e73-9e98-cc81bda742ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:31.613503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31f299-5115-4e73-9e98-cc81bda742ab None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:31.613503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31f299-5115-4e73-9e98-cc81bda742ab None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:31.613672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31f299-5115-4e73-9e98-cc81bda742ab None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:31.614394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31f299-5115-4e73-9e98-cc81bda742ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:31.614699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31f299-5115-4e73-9e98-cc81bda742ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:31.616087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31f299-5115-4e73-9e98-cc81bda742ab None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:31.626317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 86/185] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:31.627348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c60ef-9fff-4d3a-8a3d-54638ab32960 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:31.627631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c60ef-9fff-4d3a-8a3d-54638ab32960 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:31.627910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c60ef-9fff-4d3a-8a3d-54638ab32960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:31.644396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f12c60ef-9fff-4d3a-8a3d-54638ab32960 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:31.645614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f12c60ef-9fff-4d3a-8a3d-54638ab32960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:31.650008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cfddd-7e72-4fe0-bc77-6dd1791eb972 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:31.687867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65885c92-6b2a-4481-916d-9356080802ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:31.689293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65885c92-6b2a-4481-916d-9356080802ce None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:31.689794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65885c92-6b2a-4481-916d-9356080802ce None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:31.690146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65885c92-6b2a-4481-916d-9356080802ce None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:31.690947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65885c92-6b2a-4481-916d-9356080802ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:31.691264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65885c92-6b2a-4481-916d-9356080802ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:31.692677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65885c92-6b2a-4481-916d-9356080802ce None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:31.700991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 100/186] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:17:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:31.701719 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65885c92-6b2a-4481-916d-9356080802ce None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:31.712195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 87/187] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:31.712986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c60ef-9fff-4d3a-8a3d-54638ab32960 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:31.768295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:31.815698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65885c92-6b2a-4481-916d-9356080802ce None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:31.833346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c60ef-9fff-4d3a-8a3d-54638ab32960 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:31.837946 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:31.852991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ce179-c4e4-43ee-9311-a4fb559c5fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:31.853862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce179-c4e4-43ee-9311-a4fb559c5fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:31.854143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce179-c4e4-43ee-9311-a4fb559c5fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:31.854418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce179-c4e4-43ee-9311-a4fb559c5fc5 None admin] PATH_INFO: `/v3/projects/90a452f99ab34fa9880994080530d2cc` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:31.855612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ce179-c4e4-43ee-9311-a4fb559c5fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=90a452f99ab34fa9880994080530d2cc)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:31.857134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ce179-c4e4-43ee-9311-a4fb559c5fc5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:31.863575 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 101/188] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:31 2022] GET /identity/v3/projects/90a452f99ab34fa9880994080530d2cc => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:31.863575 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ce179-c4e4-43ee-9311-a4fb559c5fc5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:31.875273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efa5ec-3b76-4394-af32-86b4920927e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:31.875938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa5ec-3b76-4394-af32-86b4920927e9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:31.876221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa5ec-3b76-4394-af32-86b4920927e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:31.876500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa5ec-3b76-4394-af32-86b4920927e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:31.877380 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93efa5ec-3b76-4394-af32-86b4920927e9 None admin] RBAC: Adding query filter params (role.id=0997a26e1c354ef5b0c2730f761b47ed, scope.project.id=c3623463132749bc9f5eb4efee71c513, user.id=14f59e7f0e4d4ba5b71ec440051ccf12) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:31.877700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93efa5ec-3b76-4394-af32-86b4920927e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:31.879136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93efa5ec-3b76-4394-af32-86b4920927e9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:31.885440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 88/189] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:31 2022] GET /identity/v3/role_assignments?user.id=14f59e7f0e4d4ba5b71ec440051ccf12&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:31.886265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efa5ec-3b76-4394-af32-86b4920927e9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:32.010623 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efa5ec-3b76-4394-af32-86b4920927e9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:32.014328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ce179-c4e4-43ee-9311-a4fb559c5fc5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:32.019580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:32.052594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a369fe-e05c-489c-9d11-d9a56e7ac3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:32.053668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a369fe-e05c-489c-9d11-d9a56e7ac3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:32.053994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a369fe-e05c-489c-9d11-d9a56e7ac3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:32.054287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a369fe-e05c-489c-9d11-d9a56e7ac3b8 None admin] PATH_INFO: `/v3/users/17e97dc44d354869a8b2a8a2500daef5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:32.058296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78a53f-faa7-4ac1-b073-51d05c58266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:32.059184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78a53f-faa7-4ac1-b073-51d05c58266d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:32.059463 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78a53f-faa7-4ac1-b073-51d05c58266d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:32.059730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78a53f-faa7-4ac1-b073-51d05c58266d None admin] PATH_INFO: `/v3/users/17e97dc44d354869a8b2a8a2500daef5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:32.076229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a369fe-e05c-489c-9d11-d9a56e7ac3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=17e97dc44d354869a8b2a8a2500daef5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:32.080166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78a53f-faa7-4ac1-b073-51d05c58266d None admin] RBAC: Authorizing `identity:get_user(user_id=17e97dc44d354869a8b2a8a2500daef5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:32.080292 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a369fe-e05c-489c-9d11-d9a56e7ac3b8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:32.080366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78a53f-faa7-4ac1-b073-51d05c58266d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:32.080454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 89/190] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:31 2022] GET /identity/v3/users/17e97dc44d354869a8b2a8a2500daef5 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:32.080523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 102/191] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:31 2022] GET /identity/v3/users/17e97dc44d354869a8b2a8a2500daef5 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:32.080727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a369fe-e05c-489c-9d11-d9a56e7ac3b8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:32.085401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78a53f-faa7-4ac1-b073-51d05c58266d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:32.141538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:32.199902 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a369fe-e05c-489c-9d11-d9a56e7ac3b8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:32.205682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78a53f-faa7-4ac1-b073-51d05c58266d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:32.236216 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b996-1f3d-4917-80ae-ad272c190fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:32.237052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b996-1f3d-4917-80ae-ad272c190fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:32.237333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b996-1f3d-4917-80ae-ad272c190fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:32.237603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b996-1f3d-4917-80ae-ad272c190fc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:32.238763 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7b996-1f3d-4917-80ae-ad272c190fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:32.239819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025f0ca-abcb-4b68-8f8a-4639502abf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:32.240212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7b996-1f3d-4917-80ae-ad272c190fc5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:32.240475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025f0ca-abcb-4b68-8f8a-4639502abf14 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:32.240751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025f0ca-abcb-4b68-8f8a-4639502abf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:32.241130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025f0ca-abcb-4b68-8f8a-4639502abf14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:32.242103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025f0ca-abcb-4b68-8f8a-4639502abf14 None admin] RBAC: Adding query filter params (role.id=0997a26e1c354ef5b0c2730f761b47ed, scope.project.id=90a452f99ab34fa9880994080530d2cc, user.id=14f59e7f0e4d4ba5b71ec440051ccf12) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:32.242205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 90/192] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:32.242296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025f0ca-abcb-4b68-8f8a-4639502abf14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:32.243643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025f0ca-abcb-4b68-8f8a-4639502abf14 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:32.246156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b996-1f3d-4917-80ae-ad272c190fc5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:32.249931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 103/193] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:32 2022] GET /identity/v3/role_assignments?user.id=14f59e7f0e4d4ba5b71ec440051ccf12&scope.project.id=90a452f99ab34fa9880994080530d2cc&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:32.251454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025f0ca-abcb-4b68-8f8a-4639502abf14 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:32.281746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:32.357574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b996-1f3d-4917-80ae-ad272c190fc5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:32.364676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025f0ca-abcb-4b68-8f8a-4639502abf14 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:32.377105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:32.402157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecf316-68be-4286-9aaf-4f8f81e19831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:32.403045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecf316-68be-4286-9aaf-4f8f81e19831 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:32.403394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecf316-68be-4286-9aaf-4f8f81e19831 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:32.403635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb1343-aa1d-465d-ad1e-8d48964d7311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:32.403741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecf316-68be-4286-9aaf-4f8f81e19831 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:32.404296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1343-aa1d-465d-ad1e-8d48964d7311 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:32.404574 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1343-aa1d-465d-ad1e-8d48964d7311 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:32.404913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1343-aa1d-465d-ad1e-8d48964d7311 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:32.478338 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecf316-68be-4286-9aaf-4f8f81e19831 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:32.479542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecf316-68be-4286-9aaf-4f8f81e19831 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:32.487421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb1343-aa1d-465d-ad1e-8d48964d7311 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:32.488909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb1343-aa1d-465d-ad1e-8d48964d7311 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:32.518822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:32.590636 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 104/194] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:32.590846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 91/195] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:32.590846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837869-1de9-40c6-a0e8-9d796c970f5e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:32.590846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837869-1de9-40c6-a0e8-9d796c970f5e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:32.590846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837869-1de9-40c6-a0e8-9d796c970f5e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:32.591084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb1343-aa1d-465d-ad1e-8d48964d7311 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:32.591161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 92/196] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:32.592809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b837869-1de9-40c6-a0e8-9d796c970f5e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:32.603959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:32.689662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb1343-aa1d-465d-ad1e-8d48964d7311 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:32.697677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b837869-1de9-40c6-a0e8-9d796c970f5e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:32.722554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aa8f7-02e4-40a1-aa55-a2231fb7c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:32.723221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa8f7-02e4-40a1-aa55-a2231fb7c617 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:32.723500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa8f7-02e4-40a1-aa55-a2231fb7c617 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:32.723769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa8f7-02e4-40a1-aa55-a2231fb7c617 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:32.724480 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aa8f7-02e4-40a1-aa55-a2231fb7c617 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:32.725995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aa8f7-02e4-40a1-aa55-a2231fb7c617 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:32.726482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:32.731774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64d9e8-c6ec-4b90-8457-a70f509d9ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:32.732724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64d9e8-c6ec-4b90-8457-a70f509d9ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:32.733095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64d9e8-c6ec-4b90-8457-a70f509d9ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:32.733370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64d9e8-c6ec-4b90-8457-a70f509d9ee5 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:32.734808 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64d9e8-c6ec-4b90-8457-a70f509d9ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:32.736187 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64d9e8-c6ec-4b90-8457-a70f509d9ee5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:32.738152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 93/197] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:32 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:32.738993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64d9e8-c6ec-4b90-8457-a70f509d9ee5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:32.760986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 105/198] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:17:32 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:32.760986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f18b9-7092-4740-a6be-713b25fb85bd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:32.760986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f18b9-7092-4740-a6be-713b25fb85bd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:32.760986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f18b9-7092-4740-a6be-713b25fb85bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:32.776529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-857f18b9-7092-4740-a6be-713b25fb85bd None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:32.777901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-857f18b9-7092-4740-a6be-713b25fb85bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:32.851170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64d9e8-c6ec-4b90-8457-a70f509d9ee5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:32.859584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:32.868918 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 106/199] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:32.870595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f18b9-7092-4740-a6be-713b25fb85bd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:32.894015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8539ca-c940-4c2e-b0a5-64b6934936c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:32.894905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8539ca-c940-4c2e-b0a5-64b6934936c3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:32.895181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8539ca-c940-4c2e-b0a5-64b6934936c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:32.895448 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8539ca-c940-4c2e-b0a5-64b6934936c3 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:32.896702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8539ca-c940-4c2e-b0a5-64b6934936c3 None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:32.898349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8539ca-c940-4c2e-b0a5-64b6934936c3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:32.900119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 94/200] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:32 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:32.900913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8539ca-c940-4c2e-b0a5-64b6934936c3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:32.976950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:32.991005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f18b9-7092-4740-a6be-713b25fb85bd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:33.015863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8539ca-c940-4c2e-b0a5-64b6934936c3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:33.036578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89948f2-6a69-411a-8ff9-772ced270657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:33.037565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89948f2-6a69-411a-8ff9-772ced270657 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:33.037944 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89948f2-6a69-411a-8ff9-772ced270657 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:33.038467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89948f2-6a69-411a-8ff9-772ced270657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:33.039395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89948f2-6a69-411a-8ff9-772ced270657 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=4677125e96014a6faa77a144d1e31495, user.id=17e97dc44d354869a8b2a8a2500daef5) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:33.039792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89948f2-6a69-411a-8ff9-772ced270657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:33.041391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89948f2-6a69-411a-8ff9-772ced270657 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:33.049837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 107/201] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:32 2022] GET /identity/v3/role_assignments?user.id=17e97dc44d354869a8b2a8a2500daef5&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:33.050794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89948f2-6a69-411a-8ff9-772ced270657 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:33.061723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563332e7-1a3e-4959-ba6d-e5dc6b999ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:33.062776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563332e7-1a3e-4959-ba6d-e5dc6b999ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:33.063054 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563332e7-1a3e-4959-ba6d-e5dc6b999ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:33.063321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563332e7-1a3e-4959-ba6d-e5dc6b999ff3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:33.081808 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563332e7-1a3e-4959-ba6d-e5dc6b999ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-563332e7-1a3e-4959-ba6d-e5dc6b999ff3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:33.092244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:33.093367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:33.094460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 95/202] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:33.101502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563332e7-1a3e-4959-ba6d-e5dc6b999ff3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:33.131130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:33.181934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89948f2-6a69-411a-8ff9-772ced270657 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:33.235795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc584f71-f285-497e-b514-05472015854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:33.236470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc584f71-f285-497e-b514-05472015854e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:33.236739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc584f71-f285-497e-b514-05472015854e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:33.237032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc584f71-f285-497e-b514-05472015854e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:33.237890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc584f71-f285-497e-b514-05472015854e None admin] RBAC: Adding query filter params (role.id=ce1cbac653a64c268855a459ce0aae34, scope.project.id=4677125e96014a6faa77a144d1e31495, user.id=17e97dc44d354869a8b2a8a2500daef5) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:33.238197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc584f71-f285-497e-b514-05472015854e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:33.239662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc584f71-f285-497e-b514-05472015854e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:33.247713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 108/203] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:33 2022] GET /identity/v3/role_assignments?user.id=17e97dc44d354869a8b2a8a2500daef5&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=ce1cbac653a64c268855a459ce0aae34 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:33.249875 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563332e7-1a3e-4959-ba6d-e5dc6b999ff3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:33.293347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:33.308753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43360f-9546-4803-b6a4-6e3e5329b13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:33.309500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43360f-9546-4803-b6a4-6e3e5329b13b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:33.309785 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43360f-9546-4803-b6a4-6e3e5329b13b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:33.310067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43360f-9546-4803-b6a4-6e3e5329b13b None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:33.310875 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43360f-9546-4803-b6a4-6e3e5329b13b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:33.311188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43360f-9546-4803-b6a4-6e3e5329b13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:33.312679 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43360f-9546-4803-b6a4-6e3e5329b13b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:33.327757 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 96/204] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:33.333231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc584f71-f285-497e-b514-05472015854e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:33.476075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc584f71-f285-497e-b514-05472015854e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:33.512604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:33.525576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6a5a4-6b74-43a1-99ec-056ad656d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:33.526466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6a5a4-6b74-43a1-99ec-056ad656d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:33.526748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6a5a4-6b74-43a1-99ec-056ad656d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:33.527023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6a5a4-6b74-43a1-99ec-056ad656d2c0 None admin] PATH_INFO: `/v3/users/7a7d071ec00f413dbbd10e161b8d5396` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:33.530001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6a5a4-6b74-43a1-99ec-056ad656d2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=7a7d071ec00f413dbbd10e161b8d5396)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:33.531483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6a5a4-6b74-43a1-99ec-056ad656d2c0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:33.533182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 109/205] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:33 2022] GET /identity/v3/users/7a7d071ec00f413dbbd10e161b8d5396 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:33.538911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43360f-9546-4803-b6a4-6e3e5329b13b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:33.640771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43360f-9546-4803-b6a4-6e3e5329b13b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:33.674826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d38cdf-f1f9-4acb-ae30-8fccf2bef07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:33.675487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d38cdf-f1f9-4acb-ae30-8fccf2bef07c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:33.675769 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d38cdf-f1f9-4acb-ae30-8fccf2bef07c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:33.676042 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d38cdf-f1f9-4acb-ae30-8fccf2bef07c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:33.747479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:33.758316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d38cdf-f1f9-4acb-ae30-8fccf2bef07c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:33.760056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d38cdf-f1f9-4acb-ae30-8fccf2bef07c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:33.869577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 97/206] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:33.875229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6a5a4-6b74-43a1-99ec-056ad656d2c0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:33.999465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6a5a4-6b74-43a1-99ec-056ad656d2c0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:34.040765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed3aa-1833-4479-a22b-baae24465043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:34.041666 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed3aa-1833-4479-a22b-baae24465043 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:34.041939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed3aa-1833-4479-a22b-baae24465043 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:34.042208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed3aa-1833-4479-a22b-baae24465043 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:34.043382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed3aa-1833-4479-a22b-baae24465043 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:34.044823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed3aa-1833-4479-a22b-baae24465043 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:34.046889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 110/207] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:33 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:34.052397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d38cdf-f1f9-4acb-ae30-8fccf2bef07c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:34.210927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:34.223214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d38cdf-f1f9-4acb-ae30-8fccf2bef07c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:34.269697 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cc227-48de-494b-addb-867965dfae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:34.270282 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc227-48de-494b-addb-867965dfae27 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:34.270565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc227-48de-494b-addb-867965dfae27 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:34.270837 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc227-48de-494b-addb-867965dfae27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:34.271678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cc227-48de-494b-addb-867965dfae27 None admin] RBAC: Adding query filter params (role.id=11fdf15006214f86a22373ac8ad9db18, scope.project.id=c3623463132749bc9f5eb4efee71c513, user.id=7a7d071ec00f413dbbd10e161b8d5396) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:34.271993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cc227-48de-494b-addb-867965dfae27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:34.273514 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cc227-48de-494b-addb-867965dfae27 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:34.279768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 98/208] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:34 2022] GET /identity/v3/role_assignments?user.id=7a7d071ec00f413dbbd10e161b8d5396&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=11fdf15006214f86a22373ac8ad9db18 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:35.073312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c711ef-9fb1-4c7a-b550-67dca22e1f9d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.073858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c711ef-9fb1-4c7a-b550-67dca22e1f9d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.073858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c711ef-9fb1-4c7a-b550-67dca22e1f9d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.075229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 111/209] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:35.080450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25467720-e217-48c5-9aea-383b16ef128e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.080827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25467720-e217-48c5-9aea-383b16ef128e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.081039 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25467720-e217-48c5-9aea-383b16ef128e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.097744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-25467720-e217-48c5-9aea-383b16ef128e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:35.098918 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-25467720-e217-48c5-9aea-383b16ef128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:35.166800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 99/210] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:35.188710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c711ef-9fb1-4c7a-b550-67dca22e1f9d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:35.252084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:35.296315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c711ef-9fb1-4c7a-b550-67dca22e1f9d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:35.331192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e585d2-0194-4810-99e5-ee7d2bcad7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:35.331911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e585d2-0194-4810-99e5-ee7d2bcad7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.332182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e585d2-0194-4810-99e5-ee7d2bcad7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.332446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e585d2-0194-4810-99e5-ee7d2bcad7a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.342967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e585d2-0194-4810-99e5-ee7d2bcad7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-12e585d2-0194-4810-99e5-ee7d2bcad7a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:35.350692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:35.351623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:35.352808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 112/211] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:35.357871 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25467720-e217-48c5-9aea-383b16ef128e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:35.364351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a7184-f934-4850-813d-85a928ec200d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.364635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a7184-f934-4850-813d-85a928ec200d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.364908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a7184-f934-4850-813d-85a928ec200d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.366367 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 113/212] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:17:35.371597 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702ee21-14c6-4b53-aa8a-784ec9da5a98 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.371882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702ee21-14c6-4b53-aa8a-784ec9da5a98 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.372156 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702ee21-14c6-4b53-aa8a-784ec9da5a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.390681 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c702ee21-14c6-4b53-aa8a-784ec9da5a98 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:35.391950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c702ee21-14c6-4b53-aa8a-784ec9da5a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:35.455893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:35.467517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 114/213] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:35.473084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25467720-e217-48c5-9aea-383b16ef128e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:35.492234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702ee21-14c6-4b53-aa8a-784ec9da5a98 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:35.508500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723c479-a734-47ae-b528-4be871a525bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:35.509469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723c479-a734-47ae-b528-4be871a525bb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.509915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723c479-a734-47ae-b528-4be871a525bb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.510377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723c479-a734-47ae-b528-4be871a525bb None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.511387 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723c479-a734-47ae-b528-4be871a525bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:35.511925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723c479-a734-47ae-b528-4be871a525bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:35.513520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723c479-a734-47ae-b528-4be871a525bb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:35.523653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 100/214] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:35.528876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723c479-a734-47ae-b528-4be871a525bb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:35.554578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:35.615561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702ee21-14c6-4b53-aa8a-784ec9da5a98 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:35.649872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723c479-a734-47ae-b528-4be871a525bb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:35.656083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b8d83-42ed-49da-9e42-97c54bbeb903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:35.656886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b8d83-42ed-49da-9e42-97c54bbeb903 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.657500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b8d83-42ed-49da-9e42-97c54bbeb903 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.657500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b8d83-42ed-49da-9e42-97c54bbeb903 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.658602 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b8d83-42ed-49da-9e42-97c54bbeb903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:35.660050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b8d83-42ed-49da-9e42-97c54bbeb903 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:35.667538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 115/215] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:35.667538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894982af-7e69-43ce-bc25-33d228d0d64b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.667538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894982af-7e69-43ce-bc25-33d228d0d64b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.667538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894982af-7e69-43ce-bc25-33d228d0d64b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.667538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 116/216] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:35.670055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894982af-7e69-43ce-bc25-33d228d0d64b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:35.692306 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a295d9-1827-4689-b601-006a5b630201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:35.693212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a295d9-1827-4689-b601-006a5b630201 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.693484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a295d9-1827-4689-b601-006a5b630201 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.693746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a295d9-1827-4689-b601-006a5b630201 None admin] PATH_INFO: `/v3/users/1baf726751d64e24b387a93161ee8b6c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.706698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a295d9-1827-4689-b601-006a5b630201 None admin] RBAC: Authorizing `identity:get_user(user_id=1baf726751d64e24b387a93161ee8b6c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:35.708149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a295d9-1827-4689-b601-006a5b630201 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:35.709842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 101/217] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:35 2022] GET /identity/v3/users/1baf726751d64e24b387a93161ee8b6c => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:35.711102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00f75-acf5-4b9c-b17b-93ebafb9769a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.711383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00f75-acf5-4b9c-b17b-93ebafb9769a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.711654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00f75-acf5-4b9c-b17b-93ebafb9769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.718069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:35.728790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0ee00f75-acf5-4b9c-b17b-93ebafb9769a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:35.729988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0ee00f75-acf5-4b9c-b17b-93ebafb9769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:35.773629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894982af-7e69-43ce-bc25-33d228d0d64b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:35.791052 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:35.794117 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 102/218] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:35.802293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0483ce-80e3-4e41-8eeb-feeb92b948c4 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.802731 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0483ce-80e3-4e41-8eeb-feeb92b948c4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.803139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0483ce-80e3-4e41-8eeb-feeb92b948c4 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.804680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 103/219] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:35.805595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0483ce-80e3-4e41-8eeb-feeb92b948c4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:35.809577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb787f6-ff0e-438d-8014-8c3f12b5988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:35.810268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb787f6-ff0e-438d-8014-8c3f12b5988a None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.810685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb787f6-ff0e-438d-8014-8c3f12b5988a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.810803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb787f6-ff0e-438d-8014-8c3f12b5988a None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.811511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb787f6-ff0e-438d-8014-8c3f12b5988a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:35.812943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb787f6-ff0e-438d-8014-8c3f12b5988a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:35.836768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 117/220] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:17:35 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:17:35.838132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668454-17df-4b6e-b270-954ca2dad32a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.838545 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668454-17df-4b6e-b270-954ca2dad32a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.838825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668454-17df-4b6e-b270-954ca2dad32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.860566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d4668454-17df-4b6e-b270-954ca2dad32a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:35.862077 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d4668454-17df-4b6e-b270-954ca2dad32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:35.937332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 118/221] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:35.942011 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0483ce-80e3-4e41-8eeb-feeb92b948c4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:35.945976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4668454-17df-4b6e-b270-954ca2dad32a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:35.986579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2baa2c-4232-4947-8361-de24cfa6663e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:35.987391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2baa2c-4232-4947-8361-de24cfa6663e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:35.987732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2baa2c-4232-4947-8361-de24cfa6663e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:35.988059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2baa2c-4232-4947-8361-de24cfa6663e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:35.990881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:36.059343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2baa2c-4232-4947-8361-de24cfa6663e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:36.060822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2baa2c-4232-4947-8361-de24cfa6663e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:36.063114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4668454-17df-4b6e-b270-954ca2dad32a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:36.066578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:36.117972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ace3bc-7f62-4657-971b-e6c0f72d1539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:36.118788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ace3bc-7f62-4657-971b-e6c0f72d1539 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:36.119068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ace3bc-7f62-4657-971b-e6c0f72d1539 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:36.119338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ace3bc-7f62-4657-971b-e6c0f72d1539 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:36.132236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ace3bc-7f62-4657-971b-e6c0f72d1539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-31ace3bc-7f62-4657-971b-e6c0f72d1539 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:36.139897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:36.140784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:36.141617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 119/222] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:17:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:36.142273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ace3bc-7f62-4657-971b-e6c0f72d1539 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:36.189967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 104/223] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:36.191834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2baa2c-4232-4947-8361-de24cfa6663e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:36.232201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:36.261762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ace3bc-7f62-4657-971b-e6c0f72d1539 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:36.301648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2baa2c-4232-4947-8361-de24cfa6663e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:36.307839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbc925-d0a8-4e6b-a88a-0ebd03f06025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:36.308776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc925-d0a8-4e6b-a88a-0ebd03f06025 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:36.309619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc925-d0a8-4e6b-a88a-0ebd03f06025 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:36.309998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc925-d0a8-4e6b-a88a-0ebd03f06025 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:36.323574 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbc925-d0a8-4e6b-a88a-0ebd03f06025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-88fbc925-d0a8-4e6b-a88a-0ebd03f06025 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:36.334531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:36.335673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:36.336462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:36.337395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6748f-ae0d-40e9-96ce-2e5faa2ca206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:36.337395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6748f-ae0d-40e9-96ce-2e5faa2ca206 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:36.337395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6748f-ae0d-40e9-96ce-2e5faa2ca206 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:36.337395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6748f-ae0d-40e9-96ce-2e5faa2ca206 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:36.337636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6748f-ae0d-40e9-96ce-2e5faa2ca206 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:36.337712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 120/224] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:17:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:36.337786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6748f-ae0d-40e9-96ce-2e5faa2ca206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:36.340985 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6748f-ae0d-40e9-96ce-2e5faa2ca206 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:36.341797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbc925-d0a8-4e6b-a88a-0ebd03f06025 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:36.353623 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 105/225] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:36.354990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6748f-ae0d-40e9-96ce-2e5faa2ca206 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:36.376872 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:36.468978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbc925-d0a8-4e6b-a88a-0ebd03f06025 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:36.471537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:36.478295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6748f-ae0d-40e9-96ce-2e5faa2ca206 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:36.519402 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29d060-8ebe-43e8-8fa5-eccc995ab78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:36.520498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670e7d8-102c-49d7-863a-b7eb0e71634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:36.521106 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29d060-8ebe-43e8-8fa5-eccc995ab78a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:36.521285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670e7d8-102c-49d7-863a-b7eb0e71634d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:36.521568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670e7d8-102c-49d7-863a-b7eb0e71634d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:36.521950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670e7d8-102c-49d7-863a-b7eb0e71634d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:36.522071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29d060-8ebe-43e8-8fa5-eccc995ab78a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:36.522525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29d060-8ebe-43e8-8fa5-eccc995ab78a None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:36.522823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670e7d8-102c-49d7-863a-b7eb0e71634d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:36.523133 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670e7d8-102c-49d7-863a-b7eb0e71634d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:36.524380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29d060-8ebe-43e8-8fa5-eccc995ab78a None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:36.524637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670e7d8-102c-49d7-863a-b7eb0e71634d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:36.526386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29d060-8ebe-43e8-8fa5-eccc995ab78a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:36.528300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 121/226] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:36 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:36.529629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29d060-8ebe-43e8-8fa5-eccc995ab78a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:36.534499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 106/227] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:17:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:36.535357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670e7d8-102c-49d7-863a-b7eb0e71634d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:36.642654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:36.646840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670e7d8-102c-49d7-863a-b7eb0e71634d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:36.654468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29d060-8ebe-43e8-8fa5-eccc995ab78a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:36.690204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a3a0a-bf8f-4791-b9a3-f02e9da0605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:36.691001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a3a0a-bf8f-4791-b9a3-f02e9da0605d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:36.691402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a3a0a-bf8f-4791-b9a3-f02e9da0605d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:36.691687 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a3a0a-bf8f-4791-b9a3-f02e9da0605d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:36.692537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a3a0a-bf8f-4791-b9a3-f02e9da0605d None admin] RBAC: Adding query filter params (role.id=0997a26e1c354ef5b0c2730f761b47ed, scope.project.id=4677125e96014a6faa77a144d1e31495, user.id=1baf726751d64e24b387a93161ee8b6c) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:36.692855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a3a0a-bf8f-4791-b9a3-f02e9da0605d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:36.695313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a3a0a-bf8f-4791-b9a3-f02e9da0605d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:36.699088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1aada-c469-413c-8d9c-d800f7b84099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:36.700205 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1aada-c469-413c-8d9c-d800f7b84099 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:36.700677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1aada-c469-413c-8d9c-d800f7b84099 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:36.701182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1aada-c469-413c-8d9c-d800f7b84099 None admin] PATH_INFO: `/v3/users/17e97dc44d354869a8b2a8a2500daef5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:36.701640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 107/228] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:36 2022] GET /identity/v3/role_assignments?user.id=1baf726751d64e24b387a93161ee8b6c&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:36.702562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a3a0a-bf8f-4791-b9a3-f02e9da0605d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:36.703173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1aada-c469-413c-8d9c-d800f7b84099 None admin] RBAC: Authorizing `identity:get_user(user_id=17e97dc44d354869a8b2a8a2500daef5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:36.704992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1aada-c469-413c-8d9c-d800f7b84099 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:36.707020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 122/229] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:36 2022] GET /identity/v3/users/17e97dc44d354869a8b2a8a2500daef5 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:36.716455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1aada-c469-413c-8d9c-d800f7b84099 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:36.750771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:36.872029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1aada-c469-413c-8d9c-d800f7b84099 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:36.913563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655894e-c50e-4a41-92fb-2d17fe1a8df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:36.914664 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655894e-c50e-4a41-92fb-2d17fe1a8df5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:36.914943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655894e-c50e-4a41-92fb-2d17fe1a8df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:36.915216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655894e-c50e-4a41-92fb-2d17fe1a8df5 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:36.917084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655894e-c50e-4a41-92fb-2d17fe1a8df5 None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:36.919143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655894e-c50e-4a41-92fb-2d17fe1a8df5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:36.921121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 123/230] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:36 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:36.921773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a3a0a-bf8f-4791-b9a3-f02e9da0605d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:36.926683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655894e-c50e-4a41-92fb-2d17fe1a8df5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:36.956023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:36.961374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee92a9-8699-4960-8648-61593b2b47ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:36.962275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee92a9-8699-4960-8648-61593b2b47ed None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:36.962558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee92a9-8699-4960-8648-61593b2b47ed None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:36.962836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee92a9-8699-4960-8648-61593b2b47ed None admin] PATH_INFO: `/v3/users/17e97dc44d354869a8b2a8a2500daef5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:36.964065 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee92a9-8699-4960-8648-61593b2b47ed None admin] RBAC: Authorizing `identity:get_user(user_id=17e97dc44d354869a8b2a8a2500daef5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:36.965564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee92a9-8699-4960-8648-61593b2b47ed None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:36.967442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 108/231] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:36 2022] GET /identity/v3/users/17e97dc44d354869a8b2a8a2500daef5 => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:36.972650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee92a9-8699-4960-8648-61593b2b47ed None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:37.094946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:37.107867 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee92a9-8699-4960-8648-61593b2b47ed None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:37.113662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655894e-c50e-4a41-92fb-2d17fe1a8df5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:37.158949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a77a0-caa5-42e9-84c7-b8a1b48d0894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:37.159848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a77a0-caa5-42e9-84c7-b8a1b48d0894 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:37.160125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a77a0-caa5-42e9-84c7-b8a1b48d0894 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:37.160398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a77a0-caa5-42e9-84c7-b8a1b48d0894 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495/users/17e97dc44d354869a8b2a8a2500daef5/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:37.162205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8fc5b-037c-4625-9255-940b38b8e380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:37.162383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a77a0-caa5-42e9-84c7-b8a1b48d0894 None admin] RBAC: Authorizing `identity:create_grant(project_id=4677125e96014a6faa77a144d1e31495, user_id=17e97dc44d354869a8b2a8a2500daef5, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:37.163084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8fc5b-037c-4625-9255-940b38b8e380 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:37.163399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8fc5b-037c-4625-9255-940b38b8e380 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:37.163673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8fc5b-037c-4625-9255-940b38b8e380 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:37.163834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a77a0-caa5-42e9-84c7-b8a1b48d0894 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:37.169741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8fc5b-037c-4625-9255-940b38b8e380 None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:37.171268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8fc5b-037c-4625-9255-940b38b8e380 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:37.173104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 109/232] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:36 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:37.179077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8fc5b-037c-4625-9255-940b38b8e380 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:37.180585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 124/233] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:17:36 2022] PUT /identity/v3/projects/4677125e96014a6faa77a144d1e31495/users/17e97dc44d354869a8b2a8a2500daef5/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:37.324601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8fc5b-037c-4625-9255-940b38b8e380 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:37.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cb9c4-daa7-4bfa-837a-8e84c69e0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:37.379522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cb9c4-daa7-4bfa-837a-8e84c69e0280 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:37.379802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cb9c4-daa7-4bfa-837a-8e84c69e0280 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:37.380078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cb9c4-daa7-4bfa-837a-8e84c69e0280 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495/users/17e97dc44d354869a8b2a8a2500daef5/roles/ce1cbac653a64c268855a459ce0aae34` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:37.382783 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cb9c4-daa7-4bfa-837a-8e84c69e0280 None admin] RBAC: Authorizing `identity:create_grant(project_id=4677125e96014a6faa77a144d1e31495, user_id=17e97dc44d354869a8b2a8a2500daef5, role_id=ce1cbac653a64c268855a459ce0aae34)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:37.384247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cb9c4-daa7-4bfa-837a-8e84c69e0280 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:37.405744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 110/234] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:17:37 2022] PUT /identity/v3/projects/4677125e96014a6faa77a144d1e31495/users/17e97dc44d354869a8b2a8a2500daef5/roles/ce1cbac653a64c268855a459ce0aae34 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:38.300934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c58123-3b4a-4c2f-9c60-ce362b2b37d1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:38.301982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c58123-3b4a-4c2f-9c60-ce362b2b37d1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:38.302160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4408eb-78bf-4d07-b18c-1f47aead4249 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:38.302437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4408eb-78bf-4d07-b18c-1f47aead4249 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:38.302717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4408eb-78bf-4d07-b18c-1f47aead4249 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:38.303027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c58123-3b4a-4c2f-9c60-ce362b2b37d1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:38.304167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 111/235] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:17:38.305064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 125/236] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:38.310079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d6797-2239-48ca-8db4-b9bd6090b936 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:38.310360 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d6797-2239-48ca-8db4-b9bd6090b936 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:38.310630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d6797-2239-48ca-8db4-b9bd6090b936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:38.312778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad0f07-71ed-48c4-90bd-ccb8522e4e46 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:38.313099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad0f07-71ed-48c4-90bd-ccb8522e4e46 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:38.313370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad0f07-71ed-48c4-90bd-ccb8522e4e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:38.339315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-39ad0f07-71ed-48c4-90bd-ccb8522e4e46 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:38.340495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-39ad0f07-71ed-48c4-90bd-ccb8522e4e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:38.346956 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2d6d6797-2239-48ca-8db4-b9bd6090b936 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:38.348090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2d6d6797-2239-48ca-8db4-b9bd6090b936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:38.370948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:38.468908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 126/237] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:38.471539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 112/238] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:38.514733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad0f07-71ed-48c4-90bd-ccb8522e4e46 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:38.516542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d6797-2239-48ca-8db4-b9bd6090b936 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:38.549722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:38.642176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad0f07-71ed-48c4-90bd-ccb8522e4e46 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:38.681296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9569366-0875-4285-9730-23a234c0dc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:38.682440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569366-0875-4285-9730-23a234c0dc78 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:38.683088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569366-0875-4285-9730-23a234c0dc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:38.684316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569366-0875-4285-9730-23a234c0dc78 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:38.704408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9569366-0875-4285-9730-23a234c0dc78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c9569366-0875-4285-9730-23a234c0dc78 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:38.714582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:38.715484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:38.716273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:38.730186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 127/239] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:38.737900 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9569366-0875-4285-9730-23a234c0dc78 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:38.743632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d6797-2239-48ca-8db4-b9bd6090b936 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:38.784986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94112fe4-c87e-4733-8af1-2f15c591c852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:38.784986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94112fe4-c87e-4733-8af1-2f15c591c852 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:38.784986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94112fe4-c87e-4733-8af1-2f15c591c852 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:38.784986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94112fe4-c87e-4733-8af1-2f15c591c852 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:38.785396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94112fe4-c87e-4733-8af1-2f15c591c852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:38.785396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94112fe4-c87e-4733-8af1-2f15c591c852 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:38.785396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 113/240] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:38.792988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94112fe4-c87e-4733-8af1-2f15c591c852 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:38.842268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:38.885341 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:38.937893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94112fe4-c87e-4733-8af1-2f15c591c852 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:38.958906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9569366-0875-4285-9730-23a234c0dc78 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:38.972875 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c455c6-6836-4b83-accb-720030dd5946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:38.973583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c455c6-6836-4b83-accb-720030dd5946 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:38.973860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c455c6-6836-4b83-accb-720030dd5946 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:38.974126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c455c6-6836-4b83-accb-720030dd5946 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:38.974835 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c455c6-6836-4b83-accb-720030dd5946 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:38.976356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c455c6-6836-4b83-accb-720030dd5946 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:39.003873 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 114/241] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:17:38 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:17:39.020190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bdbe7-fcef-4bdc-b1ab-266d524534e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:39.021059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bdbe7-fcef-4bdc-b1ab-266d524534e3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:39.021338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bdbe7-fcef-4bdc-b1ab-266d524534e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:39.021609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bdbe7-fcef-4bdc-b1ab-266d524534e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:39.022388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bdbe7-fcef-4bdc-b1ab-266d524534e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:39.022738 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bdbe7-fcef-4bdc-b1ab-266d524534e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:39.024237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bdbe7-fcef-4bdc-b1ab-266d524534e3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:39.034157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 128/242] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:39.039873 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c455c6-6836-4b83-accb-720030dd5946 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:39.119026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:39.152284 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c455c6-6836-4b83-accb-720030dd5946 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:39.189459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd36b7-3ad3-408e-a490-5b5217ef6862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:39.190938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd36b7-3ad3-408e-a490-5b5217ef6862 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:39.191356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd36b7-3ad3-408e-a490-5b5217ef6862 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:39.191650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd36b7-3ad3-408e-a490-5b5217ef6862 None admin] PATH_INFO: `/v3/users/f574866cc8794b51a926dea32ae39fcf` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:39.207992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd36b7-3ad3-408e-a490-5b5217ef6862 None admin] RBAC: Authorizing `identity:get_user(user_id=f574866cc8794b51a926dea32ae39fcf)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:39.209537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd36b7-3ad3-408e-a490-5b5217ef6862 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:39.211861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 115/243] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:39 2022] GET /identity/v3/users/f574866cc8794b51a926dea32ae39fcf => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:39.217618 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bdbe7-fcef-4bdc-b1ab-266d524534e3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:39.288823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d45c-1a11-4f1e-a769-5693d3de4c90 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:39.289162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d45c-1a11-4f1e-a769-5693d3de4c90 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:39.289415 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d45c-1a11-4f1e-a769-5693d3de4c90 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:39.291051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 116/244] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:39.301614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b4ad7-ee89-4bf7-8c41-ac440abb0250 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:39.302006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b4ad7-ee89-4bf7-8c41-ac440abb0250 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:39.302456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b4ad7-ee89-4bf7-8c41-ac440abb0250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:39.326111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c62b4ad7-ee89-4bf7-8c41-ac440abb0250 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:39.327308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c62b4ad7-ee89-4bf7-8c41-ac440abb0250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:39.336640 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bdbe7-fcef-4bdc-b1ab-266d524534e3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:39.381091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb1ea5-ba84-461b-9a42-4abb2f0ed3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:39.382100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb1ea5-ba84-461b-9a42-4abb2f0ed3ee None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:39.382751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb1ea5-ba84-461b-9a42-4abb2f0ed3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:39.383038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb1ea5-ba84-461b-9a42-4abb2f0ed3ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:39.397443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:39.414432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 117/245] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:39.442075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b4ad7-ee89-4bf7-8c41-ac440abb0250 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:39.467730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb1ea5-ba84-461b-9a42-4abb2f0ed3ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:39.469782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb1ea5-ba84-461b-9a42-4abb2f0ed3ee None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:39.513359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:39.558858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b4ad7-ee89-4bf7-8c41-ac440abb0250 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:39.605235 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 129/246] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:39.611459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb1ea5-ba84-461b-9a42-4abb2f0ed3ee None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:39.611717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad928e7-871d-44dc-9533-e8bb41111c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:39.612627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad928e7-871d-44dc-9533-e8bb41111c05 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:39.612991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad928e7-871d-44dc-9533-e8bb41111c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:39.613376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad928e7-871d-44dc-9533-e8bb41111c05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:39.629438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad928e7-871d-44dc-9533-e8bb41111c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-bad928e7-871d-44dc-9533-e8bb41111c05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:39.637961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:39.638890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:39.639671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 118/247] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:39.640843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515777c-3f62-468a-ba5a-11b1c0109e92 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:39.641074 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515777c-3f62-468a-ba5a-11b1c0109e92 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:39.642342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515777c-3f62-468a-ba5a-11b1c0109e92 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:39.642831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 119/248] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:39.647381 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515777c-3f62-468a-ba5a-11b1c0109e92 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:39.657430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:39.734045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb1ea5-ba84-461b-9a42-4abb2f0ed3ee None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:39.772228 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515777c-3f62-468a-ba5a-11b1c0109e92 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:39.776244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8717c-cc37-4a49-8660-6a5375136de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:39.777039 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8717c-cc37-4a49-8660-6a5375136de8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:39.777419 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8717c-cc37-4a49-8660-6a5375136de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:39.777793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8717c-cc37-4a49-8660-6a5375136de8 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:39.779132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8717c-cc37-4a49-8660-6a5375136de8 None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:39.780768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8717c-cc37-4a49-8660-6a5375136de8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:39.783302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 130/249] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:39 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:39.784446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca119-c081-423a-a143-2863cd316f94 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:39.785215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca119-c081-423a-a143-2863cd316f94 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:39.785594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca119-c081-423a-a143-2863cd316f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:39.797829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:39.806797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-991ca119-c081-423a-a143-2863cd316f94 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:39.808763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-991ca119-c081-423a-a143-2863cd316f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:39.818542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194a4d9-f3ad-42a9-9721-4d136c440abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:39.820115 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194a4d9-f3ad-42a9-9721-4d136c440abe None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:39.820535 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194a4d9-f3ad-42a9-9721-4d136c440abe None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:39.820990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194a4d9-f3ad-42a9-9721-4d136c440abe None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:39.821914 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194a4d9-f3ad-42a9-9721-4d136c440abe None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:39.822887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194a4d9-f3ad-42a9-9721-4d136c440abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:39.825100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194a4d9-f3ad-42a9-9721-4d136c440abe None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:39.836789 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 120/250] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:39.838335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194a4d9-f3ad-42a9-9721-4d136c440abe None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:39.900172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 131/251] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:39.904982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ca119-c081-423a-a143-2863cd316f94 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:39.971929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:40.002014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194a4d9-f3ad-42a9-9721-4d136c440abe None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:40.037233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088324b6-6284-4c3c-8f7f-ceb327628858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:40.037901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088324b6-6284-4c3c-8f7f-ceb327628858 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:40.038185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088324b6-6284-4c3c-8f7f-ceb327628858 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:40.038505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088324b6-6284-4c3c-8f7f-ceb327628858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:40.039356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088324b6-6284-4c3c-8f7f-ceb327628858 None admin] RBAC: Adding query filter params (role.id=11fdf15006214f86a22373ac8ad9db18, scope.project.id=4677125e96014a6faa77a144d1e31495, user.id=f574866cc8794b51a926dea32ae39fcf) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:40.039672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088324b6-6284-4c3c-8f7f-ceb327628858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:40.041173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088324b6-6284-4c3c-8f7f-ceb327628858 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:40.047255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 121/252] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:39 2022] GET /identity/v3/role_assignments?user.id=f574866cc8794b51a926dea32ae39fcf&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=11fdf15006214f86a22373ac8ad9db18 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:40.048093 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088324b6-6284-4c3c-8f7f-ceb327628858 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:40.053097 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ca119-c081-423a-a143-2863cd316f94 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:40.095329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8f279-f44f-4d01-af53-0fc0f7b01006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:40.096534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8f279-f44f-4d01-af53-0fc0f7b01006 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:40.096984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8f279-f44f-4d01-af53-0fc0f7b01006 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:40.097495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8f279-f44f-4d01-af53-0fc0f7b01006 None admin] PATH_INFO: `/v3/users/1baf726751d64e24b387a93161ee8b6c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:40.098386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:40.099849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8f279-f44f-4d01-af53-0fc0f7b01006 None admin] RBAC: Authorizing `identity:get_user(user_id=1baf726751d64e24b387a93161ee8b6c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:40.101550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8f279-f44f-4d01-af53-0fc0f7b01006 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:40.103794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 132/253] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:39 2022] GET /identity/v3/users/1baf726751d64e24b387a93161ee8b6c => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:40.105352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcc9d0-b456-4daa-9ef0-b9f3ca229ea3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:40.105800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcc9d0-b456-4daa-9ef0-b9f3ca229ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:40.106260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcc9d0-b456-4daa-9ef0-b9f3ca229ea3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:40.111793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 133/254] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:40.113315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcc9d0-b456-4daa-9ef0-b9f3ca229ea3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:40.182963 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088324b6-6284-4c3c-8f7f-ceb327628858 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:40.247386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b383a-d9a1-4d1c-8fc5-b744f338c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:40.248248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b383a-d9a1-4d1c-8fc5-b744f338c812 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:40.248524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b383a-d9a1-4d1c-8fc5-b744f338c812 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:40.250195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b383a-d9a1-4d1c-8fc5-b744f338c812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:40.259547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcc9d0-b456-4daa-9ef0-b9f3ca229ea3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:40.270931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:40.274519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b383a-d9a1-4d1c-8fc5-b744f338c812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c85b383a-d9a1-4d1c-8fc5-b744f338c812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:40.283312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:40.284226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:40.285040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:40.287613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 122/255] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:17:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:40.289276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f8046-5199-4142-915e-624fdfc6e136 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:40.289773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f8046-5199-4142-915e-624fdfc6e136 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:40.290260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f8046-5199-4142-915e-624fdfc6e136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:40.311268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6b8f8046-5199-4142-915e-624fdfc6e136 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:40.312813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6b8f8046-5199-4142-915e-624fdfc6e136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:40.326374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eeb201-414b-45de-9e68-5d149934283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:40.327202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeb201-414b-45de-9e68-5d149934283f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:40.327480 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeb201-414b-45de-9e68-5d149934283f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:40.327751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeb201-414b-45de-9e68-5d149934283f None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:40.328932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eeb201-414b-45de-9e68-5d149934283f None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:40.330406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eeb201-414b-45de-9e68-5d149934283f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:40.341414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 134/256] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:40 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:40.342374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eeb201-414b-45de-9e68-5d149934283f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:40.394965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 123/257] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:40.396276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f8046-5199-4142-915e-624fdfc6e136 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:40.475631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:40.522398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eeb201-414b-45de-9e68-5d149934283f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:40.579763 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f8046-5199-4142-915e-624fdfc6e136 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:40.614790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a772902-0b3d-49de-b501-22346f722df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:40.615579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a772902-0b3d-49de-b501-22346f722df4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:40.615864 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a772902-0b3d-49de-b501-22346f722df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:40.616139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a772902-0b3d-49de-b501-22346f722df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:40.617038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a772902-0b3d-49de-b501-22346f722df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:40.617350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a772902-0b3d-49de-b501-22346f722df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:40.618492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aabc48-f9c0-4f34-93c8-3262374569db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:40.618852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a772902-0b3d-49de-b501-22346f722df4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:40.619794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabc48-f9c0-4f34-93c8-3262374569db None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:40.620526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabc48-f9c0-4f34-93c8-3262374569db None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:40.621017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabc48-f9c0-4f34-93c8-3262374569db None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495/users/1baf726751d64e24b387a93161ee8b6c/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:40.626677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aabc48-f9c0-4f34-93c8-3262374569db None admin] RBAC: Authorizing `identity:create_grant(project_id=4677125e96014a6faa77a144d1e31495, user_id=1baf726751d64e24b387a93161ee8b6c, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:40.628316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aabc48-f9c0-4f34-93c8-3262374569db None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:40.640507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 135/258] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:40.641427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a772902-0b3d-49de-b501-22346f722df4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:40.652285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 124/259] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:17:40 2022] PUT /identity/v3/projects/4677125e96014a6faa77a144d1e31495/users/1baf726751d64e24b387a93161ee8b6c/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:40.655095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aabc48-f9c0-4f34-93c8-3262374569db None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:40.731972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:40.905308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:40.905509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a772902-0b3d-49de-b501-22346f722df4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:40.912857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aabc48-f9c0-4f34-93c8-3262374569db None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:40.965691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb12756-3d93-4e29-8035-2ca38e0cc951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:40.966859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb12756-3d93-4e29-8035-2ca38e0cc951 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:40.967332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb12756-3d93-4e29-8035-2ca38e0cc951 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:40.967799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb12756-3d93-4e29-8035-2ca38e0cc951 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:40.978814 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb12756-3d93-4e29-8035-2ca38e0cc951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4fb12756-3d93-4e29-8035-2ca38e0cc951 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:40.987137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:40.988019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:40.988836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:40.991219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 136/260] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:17:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:40.998182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb12756-3d93-4e29-8035-2ca38e0cc951 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:40.998525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ce1ef-5cd2-468f-80f8-4042bd4929fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:40.999437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce1ef-5cd2-468f-80f8-4042bd4929fe None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:40.999710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce1ef-5cd2-468f-80f8-4042bd4929fe None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:40.999990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce1ef-5cd2-468f-80f8-4042bd4929fe None admin] PATH_INFO: `/v3/users/17e97dc44d354869a8b2a8a2500daef5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:41.001738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ce1ef-5cd2-468f-80f8-4042bd4929fe None admin] RBAC: Authorizing `identity:get_user(user_id=17e97dc44d354869a8b2a8a2500daef5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:41.003218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ce1ef-5cd2-468f-80f8-4042bd4929fe None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:41.004898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 125/261] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:40 2022] GET /identity/v3/users/17e97dc44d354869a8b2a8a2500daef5 => generated 283 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:41.010819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ce1ef-5cd2-468f-80f8-4042bd4929fe None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:41.101303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:41.107978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb12756-3d93-4e29-8035-2ca38e0cc951 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:41.142735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfd955-3aaf-411b-8e4d-a5dd0fa3eb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:41.143550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfd955-3aaf-411b-8e4d-a5dd0fa3eb80 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:41.143929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfd955-3aaf-411b-8e4d-a5dd0fa3eb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:41.144298 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfd955-3aaf-411b-8e4d-a5dd0fa3eb80 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:41.145199 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfd955-3aaf-411b-8e4d-a5dd0fa3eb80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:41.145605 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfd955-3aaf-411b-8e4d-a5dd0fa3eb80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:41.147110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfd955-3aaf-411b-8e4d-a5dd0fa3eb80 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:41.156130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 137/262] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:17:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:41.161285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfd955-3aaf-411b-8e4d-a5dd0fa3eb80 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:41.202944 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ce1ef-5cd2-468f-80f8-4042bd4929fe None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:41.271022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfd955-3aaf-411b-8e4d-a5dd0fa3eb80 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:41.298721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7e8d9-64d0-4bac-b51e-b1b8781f6385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:41.299395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7e8d9-64d0-4bac-b51e-b1b8781f6385 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:41.299684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7e8d9-64d0-4bac-b51e-b1b8781f6385 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:41.299960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7e8d9-64d0-4bac-b51e-b1b8781f6385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:41.306659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c240-9d9f-4ec2-98d3-d0037b8fce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:41.307810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c240-9d9f-4ec2-98d3-d0037b8fce63 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:41.308239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c240-9d9f-4ec2-98d3-d0037b8fce63 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:41.308578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c240-9d9f-4ec2-98d3-d0037b8fce63 None admin] PATH_INFO: `/v3/users/17e97dc44d354869a8b2a8a2500daef5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:41.309961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2c240-9d9f-4ec2-98d3-d0037b8fce63 None admin] RBAC: Authorizing `identity:get_user(user_id=17e97dc44d354869a8b2a8a2500daef5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:41.311526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2c240-9d9f-4ec2-98d3-d0037b8fce63 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:41.313747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 138/263] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:41 2022] GET /identity/v3/users/17e97dc44d354869a8b2a8a2500daef5 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:41.318882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c240-9d9f-4ec2-98d3-d0037b8fce63 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:41.357522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:41.376620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:41.426112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c240-9d9f-4ec2-98d3-d0037b8fce63 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:41.439204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7e8d9-64d0-4bac-b51e-b1b8781f6385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:41.440699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7e8d9-64d0-4bac-b51e-b1b8781f6385 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:41.461221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab713c67-da38-42e0-b2d0-d215ea19c28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:41.462137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab713c67-da38-42e0-b2d0-d215ea19c28e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:41.462985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab713c67-da38-42e0-b2d0-d215ea19c28e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:41.463458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab713c67-da38-42e0-b2d0-d215ea19c28e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:41.536527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab713c67-da38-42e0-b2d0-d215ea19c28e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:41.538453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab713c67-da38-42e0-b2d0-d215ea19c28e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:41.566027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:41.645909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 139/264] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:41.654107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab713c67-da38-42e0-b2d0-d215ea19c28e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:41.673298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 126/265] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:17:41.677776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7e8d9-64d0-4bac-b51e-b1b8781f6385 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:41.777688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:41.821466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab713c67-da38-42e0-b2d0-d215ea19c28e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:41.833822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7e8d9-64d0-4bac-b51e-b1b8781f6385 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:41.860223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:41.869214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407e708-31e3-46a2-87a9-41cc09897553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:41.870176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e708-31e3-46a2-87a9-41cc09897553 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:41.870518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e708-31e3-46a2-87a9-41cc09897553 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:41.870853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e708-31e3-46a2-87a9-41cc09897553 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:41.872109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e708-31e3-46a2-87a9-41cc09897553 None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:41.873666 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e708-31e3-46a2-87a9-41cc09897553 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:41.875801 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 140/266] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:41 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:41.877151 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56834d56-8ec6-4691-9492-ea6f5d9db899 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:41.877517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56834d56-8ec6-4691-9492-ea6f5d9db899 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:41.877856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56834d56-8ec6-4691-9492-ea6f5d9db899 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:41.879300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 141/267] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:41.884319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56834d56-8ec6-4691-9492-ea6f5d9db899 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:41.910776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932afe83-35c0-4339-9609-6112ec2e0c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:41.911568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932afe83-35c0-4339-9609-6112ec2e0c19 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:41.911848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932afe83-35c0-4339-9609-6112ec2e0c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:41.912212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932afe83-35c0-4339-9609-6112ec2e0c19 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:41.913508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932afe83-35c0-4339-9609-6112ec2e0c19 None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:41.914977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932afe83-35c0-4339-9609-6112ec2e0c19 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:41.921382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 127/268] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:41 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:41.922780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebf4cc-7d2a-40c6-aa23-a97df540224d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:41.923064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebf4cc-7d2a-40c6-aa23-a97df540224d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:41.923337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebf4cc-7d2a-40c6-aa23-a97df540224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:41.956189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bbebf4cc-7d2a-40c6-aa23-a97df540224d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:41.957500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bbebf4cc-7d2a-40c6-aa23-a97df540224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:41.986934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56834d56-8ec6-4691-9492-ea6f5d9db899 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:42.021301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e14bb5-faac-4829-b522-8d50e696bc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:42.021959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e14bb5-faac-4829-b522-8d50e696bc97 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:42.022234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e14bb5-faac-4829-b522-8d50e696bc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:42.022503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e14bb5-faac-4829-b522-8d50e696bc97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:42.023367 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e14bb5-faac-4829-b522-8d50e696bc97 None admin] RBAC: Adding query filter params (role.id=ce1cbac653a64c268855a459ce0aae34, scope.project.id=4677125e96014a6faa77a144d1e31495, user.id=17e97dc44d354869a8b2a8a2500daef5) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:42.023674 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e14bb5-faac-4829-b522-8d50e696bc97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:42.025127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e14bb5-faac-4829-b522-8d50e696bc97 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:42.031815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 142/269] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:41 2022] GET /identity/v3/role_assignments?user.id=17e97dc44d354869a8b2a8a2500daef5&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=ce1cbac653a64c268855a459ce0aae34 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:42.032672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e14bb5-faac-4829-b522-8d50e696bc97 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:42.090074 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 128/270] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:42.109346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:42.146435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebf4cc-7d2a-40c6-aa23-a97df540224d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:42.166401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e14bb5-faac-4829-b522-8d50e696bc97 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:42.206280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bd849-26ff-47f3-9f06-f5bdf81a0f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:42.207294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bd849-26ff-47f3-9f06-f5bdf81a0f16 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:42.207742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bd849-26ff-47f3-9f06-f5bdf81a0f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:42.208182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bd849-26ff-47f3-9f06-f5bdf81a0f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:42.209244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bd849-26ff-47f3-9f06-f5bdf81a0f16 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=4677125e96014a6faa77a144d1e31495, user.id=17e97dc44d354869a8b2a8a2500daef5) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:42.209741 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bd849-26ff-47f3-9f06-f5bdf81a0f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:42.212071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bd849-26ff-47f3-9f06-f5bdf81a0f16 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:42.219765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 143/271] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:42 2022] GET /identity/v3/role_assignments?user.id=17e97dc44d354869a8b2a8a2500daef5&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:42.260411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:42.312364 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebf4cc-7d2a-40c6-aa23-a97df540224d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:42.356434 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865b4d4-5b83-4790-b8a9-f6b63537fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:42.357636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865b4d4-5b83-4790-b8a9-f6b63537fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:42.358087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865b4d4-5b83-4790-b8a9-f6b63537fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:42.358522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865b4d4-5b83-4790-b8a9-f6b63537fdf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:42.370875 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865b4d4-5b83-4790-b8a9-f6b63537fdf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9865b4d4-5b83-4790-b8a9-f6b63537fdf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:42.379436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:42.380379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:42.381189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:42.387378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 129/272] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:17:42.390885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bd849-26ff-47f3-9f06-f5bdf81a0f16 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:42.498613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bd849-26ff-47f3-9f06-f5bdf81a0f16 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:42.525347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:42.536383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08f91f-4254-4cd0-ada8-7c2359656c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:42.537109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f91f-4254-4cd0-ada8-7c2359656c8c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:42.537408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f91f-4254-4cd0-ada8-7c2359656c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:42.537671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f91f-4254-4cd0-ada8-7c2359656c8c None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:42.538490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08f91f-4254-4cd0-ada8-7c2359656c8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:42.538803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08f91f-4254-4cd0-ada8-7c2359656c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:42.540224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08f91f-4254-4cd0-ada8-7c2359656c8c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:42.554257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 144/273] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:42.555756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865b4d4-5b83-4790-b8a9-f6b63537fdf7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:42.614910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5e0b6-1cbf-45a9-9d5f-58d90ed43fa1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:42.615196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5e0b6-1cbf-45a9-9d5f-58d90ed43fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:42.615475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5e0b6-1cbf-45a9-9d5f-58d90ed43fa1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:42.616945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 145/274] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:42.626988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170e6a2-e069-41e8-9e82-a8cd49bef6a4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:42.627306 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170e6a2-e069-41e8-9e82-a8cd49bef6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:42.628079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170e6a2-e069-41e8-9e82-a8cd49bef6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:42.652549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3170e6a2-e069-41e8-9e82-a8cd49bef6a4 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:42.654292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3170e6a2-e069-41e8-9e82-a8cd49bef6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:42.685647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865b4d4-5b83-4790-b8a9-f6b63537fdf7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:42.717000 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:42.735698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e02a-fe0d-46e8-8b0d-ef5cb45514e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:42.736640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e02a-fe0d-46e8-8b0d-ef5cb45514e8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:42.737068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e02a-fe0d-46e8-8b0d-ef5cb45514e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:42.737555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e02a-fe0d-46e8-8b0d-ef5cb45514e8 None admin] PATH_INFO: `/v3/users/8b2dd93ace7e45ea94a778c7214c15bf` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:42.752241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 146/275] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:42.758200 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e02a-fe0d-46e8-8b0d-ef5cb45514e8 None admin] RBAC: Authorizing `identity:get_user(user_id=8b2dd93ace7e45ea94a778c7214c15bf)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:42.759950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e02a-fe0d-46e8-8b0d-ef5cb45514e8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:42.766628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 130/276] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:42 2022] GET /identity/v3/users/8b2dd93ace7e45ea94a778c7214c15bf => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:42.768152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170e6a2-e069-41e8-9e82-a8cd49bef6a4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:42.785727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e02a-fe0d-46e8-8b0d-ef5cb45514e8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:42.911727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170e6a2-e069-41e8-9e82-a8cd49bef6a4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:42.927274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:42.929585 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e02a-fe0d-46e8-8b0d-ef5cb45514e8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:42.951807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490614ce-cff5-42d3-9d9e-83bc2c858157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:42.953019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490614ce-cff5-42d3-9d9e-83bc2c858157 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:42.953480 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490614ce-cff5-42d3-9d9e-83bc2c858157 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:42.954326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490614ce-cff5-42d3-9d9e-83bc2c858157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:42.955343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490614ce-cff5-42d3-9d9e-83bc2c858157 None admin] RBAC: Adding query filter params (role.id=0997a26e1c354ef5b0c2730f761b47ed, user.id=8b2dd93ace7e45ea94a778c7214c15bf, scope.system=all) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:42.955832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490614ce-cff5-42d3-9d9e-83bc2c858157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:42.957989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490614ce-cff5-42d3-9d9e-83bc2c858157 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:42.966754 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 147/277] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Jul 6 20:17:42 2022] GET /identity/v3/role_assignments?user.id=8b2dd93ace7e45ea94a778c7214c15bf&scope.system=all&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:42.968534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8281-596c-40eb-aad8-fc4429998fc5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:42.968992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8281-596c-40eb-aad8-fc4429998fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:42.969642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8281-596c-40eb-aad8-fc4429998fc5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:42.971892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 148/278] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:42.979209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaab105-c55f-417e-9f80-e7f4b2203b38 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:42.979768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaab105-c55f-417e-9f80-e7f4b2203b38 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:42.980192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaab105-c55f-417e-9f80-e7f4b2203b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:42.980578 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37e5ca-c737-413f-9a6d-42967d0e22e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:42.981593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e5ca-c737-413f-9a6d-42967d0e22e3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:42.981906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e5ca-c737-413f-9a6d-42967d0e22e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:42.982181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e5ca-c737-413f-9a6d-42967d0e22e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:42.983832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37e5ca-c737-413f-9a6d-42967d0e22e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:42.985501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37e5ca-c737-413f-9a6d-42967d0e22e3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:42.987272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 131/279] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:42.995354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37e5ca-c737-413f-9a6d-42967d0e22e3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:43.001498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-eeaab105-c55f-417e-9f80-e7f4b2203b38 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:43.003119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eeaab105-c55f-417e-9f80-e7f4b2203b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:43.069814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:43.089060 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 149/280] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:43.114467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaab105-c55f-417e-9f80-e7f4b2203b38 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:43.141594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37e5ca-c737-413f-9a6d-42967d0e22e3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:43.190836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9840a-dc85-49b1-9b85-756a97976eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:43.192294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9840a-dc85-49b1-9b85-756a97976eb9 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:43.192765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9840a-dc85-49b1-9b85-756a97976eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:43.193413 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9840a-dc85-49b1-9b85-756a97976eb9 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:43.194460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9840a-dc85-49b1-9b85-756a97976eb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:43.196703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9840a-dc85-49b1-9b85-756a97976eb9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:43.223508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 132/281] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:17:42 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:43.256446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaab105-c55f-417e-9f80-e7f4b2203b38 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:43.269558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:43.300808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcb22a-8d1e-42d7-b6e4-4b31bc41c5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:43.301716 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb22a-8d1e-42d7-b6e4-4b31bc41c5bc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:43.301995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb22a-8d1e-42d7-b6e4-4b31bc41c5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:43.302265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb22a-8d1e-42d7-b6e4-4b31bc41c5bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:43.315265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcb22a-8d1e-42d7-b6e4-4b31bc41c5bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a8dcb22a-8d1e-42d7-b6e4-4b31bc41c5bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:43.323516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:43.324687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:43.325756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 150/282] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:17:43.330965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9840a-dc85-49b1-9b85-756a97976eb9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:43.436152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9840a-dc85-49b1-9b85-756a97976eb9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:43.439665 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:43.474671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfaef2-5c25-4a96-9221-965c3de012f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:43.475351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfaef2-5c25-4a96-9221-965c3de012f7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:43.475629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfaef2-5c25-4a96-9221-965c3de012f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:43.475960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfaef2-5c25-4a96-9221-965c3de012f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:43.476725 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfaef2-5c25-4a96-9221-965c3de012f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:43.477055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfaef2-5c25-4a96-9221-965c3de012f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:43.478433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfaef2-5c25-4a96-9221-965c3de012f7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:43.487810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 133/283] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:43.493472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcb22a-8d1e-42d7-b6e4-4b31bc41c5bc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:43.588779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8899a-30d2-4cbc-b0ad-899362b52dbc None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:43.589302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8899a-30d2-4cbc-b0ad-899362b52dbc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:43.589577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8899a-30d2-4cbc-b0ad-899362b52dbc None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:43.591658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 134/284] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:17:43.597245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5968-e596-4ad9-b864-c13b48e02c7b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:43.598002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5968-e596-4ad9-b864-c13b48e02c7b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:43.598493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5968-e596-4ad9-b864-c13b48e02c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:43.605935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcb22a-8d1e-42d7-b6e4-4b31bc41c5bc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:43.620768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fdca5968-e596-4ad9-b864-c13b48e02c7b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:43.622244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fdca5968-e596-4ad9-b864-c13b48e02c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:43.650551 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb7398-1029-4b31-a0af-4d2d99c4721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:43.651925 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7398-1029-4b31-a0af-4d2d99c4721a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:43.652395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7398-1029-4b31-a0af-4d2d99c4721a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:43.652854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7398-1029-4b31-a0af-4d2d99c4721a None admin] PATH_INFO: `/v3/users/f574866cc8794b51a926dea32ae39fcf` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:43.654825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb7398-1029-4b31-a0af-4d2d99c4721a None admin] RBAC: Authorizing `identity:get_user(user_id=f574866cc8794b51a926dea32ae39fcf)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:43.656486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb7398-1029-4b31-a0af-4d2d99c4721a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:43.658348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 151/285] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:43 2022] GET /identity/v3/users/f574866cc8794b51a926dea32ae39fcf => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:43.666694 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb7398-1029-4b31-a0af-4d2d99c4721a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:43.696528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 135/286] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:43.713424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:43.720118 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca5968-e596-4ad9-b864-c13b48e02c7b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:43.773263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb7398-1029-4b31-a0af-4d2d99c4721a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:43.821442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:43.825055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca5968-e596-4ad9-b864-c13b48e02c7b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:43.828480 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ea36e-1126-48a3-ae3c-4037f3057601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:43.829681 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ea36e-1126-48a3-ae3c-4037f3057601 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:43.830101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ea36e-1126-48a3-ae3c-4037f3057601 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:43.830527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ea36e-1126-48a3-ae3c-4037f3057601 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:43.831933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ea36e-1126-48a3-ae3c-4037f3057601 None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:43.833562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ea36e-1126-48a3-ae3c-4037f3057601 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:43.835781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 152/287] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:43 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:43.841412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ea36e-1126-48a3-ae3c-4037f3057601 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:43.862738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df50f9-54ca-480b-be90-cc9c2709c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:43.863906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df50f9-54ca-480b-be90-cc9c2709c44a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:43.864383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df50f9-54ca-480b-be90-cc9c2709c44a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:43.864849 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df50f9-54ca-480b-be90-cc9c2709c44a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:43.876205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df50f9-54ca-480b-be90-cc9c2709c44a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-18df50f9-54ca-480b-be90-cc9c2709c44a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:43.885075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:43.885965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:43.886782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:43.889174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 136/288] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:17:43.895179 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df50f9-54ca-480b-be90-cc9c2709c44a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:44.003621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df50f9-54ca-480b-be90-cc9c2709c44a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:44.057267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ea36e-1126-48a3-ae3c-4037f3057601 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:44.061321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:44.076429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235de602-6542-40cd-9787-4cc7b4708ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:44.077486 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235de602-6542-40cd-9787-4cc7b4708ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:44.077968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235de602-6542-40cd-9787-4cc7b4708ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:44.078463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235de602-6542-40cd-9787-4cc7b4708ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:44.079429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235de602-6542-40cd-9787-4cc7b4708ce9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:44.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235de602-6542-40cd-9787-4cc7b4708ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:44.082482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235de602-6542-40cd-9787-4cc7b4708ce9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:44.105399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 137/289] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:44.110479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235de602-6542-40cd-9787-4cc7b4708ce9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:44.135102 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd308-e48d-4a64-bc75-cfb8dcd31f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:44.136463 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd308-e48d-4a64-bc75-cfb8dcd31f20 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:44.136943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd308-e48d-4a64-bc75-cfb8dcd31f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:44.137631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd308-e48d-4a64-bc75-cfb8dcd31f20 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495/users/f574866cc8794b51a926dea32ae39fcf/roles/11fdf15006214f86a22373ac8ad9db18` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:44.142092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffd308-e48d-4a64-bc75-cfb8dcd31f20 None admin] RBAC: Authorizing `identity:create_grant(project_id=4677125e96014a6faa77a144d1e31495, user_id=f574866cc8794b51a926dea32ae39fcf, role_id=11fdf15006214f86a22373ac8ad9db18)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:44.146073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffd308-e48d-4a64-bc75-cfb8dcd31f20 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:44.152293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:44.169624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 153/290] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:17:43 2022] PUT /identity/v3/projects/4677125e96014a6faa77a144d1e31495/users/f574866cc8794b51a926dea32ae39fcf/roles/11fdf15006214f86a22373ac8ad9db18 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:44.264895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235de602-6542-40cd-9787-4cc7b4708ce9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:44.313436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81304609-df55-4c47-b043-a25d220776a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:44.314707 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81304609-df55-4c47-b043-a25d220776a3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:44.315185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81304609-df55-4c47-b043-a25d220776a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:44.315672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81304609-df55-4c47-b043-a25d220776a3 None admin] PATH_INFO: `/v3/users/1baf726751d64e24b387a93161ee8b6c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:44.321862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81304609-df55-4c47-b043-a25d220776a3 None admin] RBAC: Authorizing `identity:get_user(user_id=1baf726751d64e24b387a93161ee8b6c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:44.325058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81304609-df55-4c47-b043-a25d220776a3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:44.328595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 138/291] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:44 2022] GET /identity/v3/users/1baf726751d64e24b387a93161ee8b6c => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:44.335874 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd308-e48d-4a64-bc75-cfb8dcd31f20 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:44.443159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd308-e48d-4a64-bc75-cfb8dcd31f20 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:44.478112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17e68b-2edb-4e39-bf60-65b5b6d0b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:44.479171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17e68b-2edb-4e39-bf60-65b5b6d0b197 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:44.479650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17e68b-2edb-4e39-bf60-65b5b6d0b197 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:44.480174 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17e68b-2edb-4e39-bf60-65b5b6d0b197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:44.514263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:44.557374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17e68b-2edb-4e39-bf60-65b5b6d0b197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:44.559275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17e68b-2edb-4e39-bf60-65b5b6d0b197 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:44.665328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 154/292] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:44.671214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81304609-df55-4c47-b043-a25d220776a3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:44.760936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:44.776065 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81304609-df55-4c47-b043-a25d220776a3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:44.815588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60af59-fcc9-4ac2-98a0-f43e7871fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:44.816474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60af59-fcc9-4ac2-98a0-f43e7871fa62 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:44.816752 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60af59-fcc9-4ac2-98a0-f43e7871fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:44.817073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60af59-fcc9-4ac2-98a0-f43e7871fa62 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:44.821723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60af59-fcc9-4ac2-98a0-f43e7871fa62 None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:44.823384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60af59-fcc9-4ac2-98a0-f43e7871fa62 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:44.825397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 139/293] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:44 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:44.831055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17e68b-2edb-4e39-bf60-65b5b6d0b197 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:44.925875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:44.975795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17e68b-2edb-4e39-bf60-65b5b6d0b197 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:45.015571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f59bed-64a9-4def-91ae-fe23e002256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:45.016154 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f59bed-64a9-4def-91ae-fe23e002256d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:45.016439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f59bed-64a9-4def-91ae-fe23e002256d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:45.016717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f59bed-64a9-4def-91ae-fe23e002256d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:45.017597 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f59bed-64a9-4def-91ae-fe23e002256d None admin] RBAC: Adding query filter params (role.id=0997a26e1c354ef5b0c2730f761b47ed, scope.project.id=4677125e96014a6faa77a144d1e31495, user.id=1baf726751d64e24b387a93161ee8b6c) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:45.017913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f59bed-64a9-4def-91ae-fe23e002256d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:45.019353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f59bed-64a9-4def-91ae-fe23e002256d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:45.025491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 155/294] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:44 2022] GET /identity/v3/role_assignments?user.id=1baf726751d64e24b387a93161ee8b6c&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:45.186047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343741b3-5932-4965-9802-33aabf25481b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:45.186372 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343741b3-5932-4965-9802-33aabf25481b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:45.186610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343741b3-5932-4965-9802-33aabf25481b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:45.188261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 140/295] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:45.193745 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897242-ecbe-426b-801f-492a5d08f832 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:45.194035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897242-ecbe-426b-801f-492a5d08f832 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:45.194327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897242-ecbe-426b-801f-492a5d08f832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:45.214011 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-12897242-ecbe-426b-801f-492a5d08f832 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:45.215221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-12897242-ecbe-426b-801f-492a5d08f832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:45.289146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 156/296] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:45.308557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343741b3-5932-4965-9802-33aabf25481b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:45.423230 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343741b3-5932-4965-9802-33aabf25481b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:45.457926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263e576-70b0-412e-96cf-3c7a9b156e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:45.458831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263e576-70b0-412e-96cf-3c7a9b156e43 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:45.459122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263e576-70b0-412e-96cf-3c7a9b156e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:45.459403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263e576-70b0-412e-96cf-3c7a9b156e43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:45.470390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263e576-70b0-412e-96cf-3c7a9b156e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0263e576-70b0-412e-96cf-3c7a9b156e43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:45.478279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:45.479139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:45.479933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:45.484395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 141/297] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:45.485823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897242-ecbe-426b-801f-492a5d08f832 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:45.547846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:45.596538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897242-ecbe-426b-801f-492a5d08f832 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:45.632100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9b7e2-8b28-48a2-a055-a55e5158ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:45.632842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b7e2-8b28-48a2-a055-a55e5158ef4d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:45.633150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b7e2-8b28-48a2-a055-a55e5158ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:45.633424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b7e2-8b28-48a2-a055-a55e5158ef4d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:45.634190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9b7e2-8b28-48a2-a055-a55e5158ef4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:45.634497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9b7e2-8b28-48a2-a055-a55e5158ef4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:45.635885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9b7e2-8b28-48a2-a055-a55e5158ef4d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:45.649152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 157/298] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:45.650624 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263e576-70b0-412e-96cf-3c7a9b156e43 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:45.667938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:45.753321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263e576-70b0-412e-96cf-3c7a9b156e43 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:45.788610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05771acb-70a1-4fc9-b162-31457a5f392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:45.789519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05771acb-70a1-4fc9-b162-31457a5f392d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:45.789801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05771acb-70a1-4fc9-b162-31457a5f392d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:45.790079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05771acb-70a1-4fc9-b162-31457a5f392d None admin] PATH_INFO: `/v3/users/8b2dd93ace7e45ea94a778c7214c15bf` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:45.791288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05771acb-70a1-4fc9-b162-31457a5f392d None admin] RBAC: Authorizing `identity:get_user(user_id=8b2dd93ace7e45ea94a778c7214c15bf)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:45.792754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05771acb-70a1-4fc9-b162-31457a5f392d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:45.799153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 142/299] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:45 2022] GET /identity/v3/users/8b2dd93ace7e45ea94a778c7214c15bf => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:45.800447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9b7e2-8b28-48a2-a055-a55e5158ef4d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:45.884312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a544a3-e485-4d31-9b06-c50208c39684 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:45.885009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a544a3-e485-4d31-9b06-c50208c39684 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:45.885502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a544a3-e485-4d31-9b06-c50208c39684 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:45.887483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 143/300] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:45.893304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3d73e-afce-492f-ad90-bb0e76d950fc None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:45.893840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3d73e-afce-492f-ad90-bb0e76d950fc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:45.894342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3d73e-afce-492f-ad90-bb0e76d950fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:45.912226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1fc3d73e-afce-492f-ad90-bb0e76d950fc None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:45.913974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1fc3d73e-afce-492f-ad90-bb0e76d950fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:45.917759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9b7e2-8b28-48a2-a055-a55e5158ef4d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:45.939254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:45.954803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6995cf6-4fba-4d56-bba2-e825556edb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:45.955678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6995cf6-4fba-4d56-bba2-e825556edb00 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:45.955960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6995cf6-4fba-4d56-bba2-e825556edb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:45.956238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6995cf6-4fba-4d56-bba2-e825556edb00 None admin] PATH_INFO: `/v3/system/users/8b2dd93ace7e45ea94a778c7214c15bf/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:45.957763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6995cf6-4fba-4d56-bba2-e825556edb00 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8b2dd93ace7e45ea94a778c7214c15bf, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:45.959150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6995cf6-4fba-4d56-bba2-e825556edb00 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:45.968602 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 158/301] 10.222.0.30 () {58 vars in 1334 bytes} [Wed Jul 6 20:17:45 2022] PUT /identity/v3/system/users/8b2dd93ace7e45ea94a778c7214c15bf/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:45.975534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d762c-428e-4198-b3b4-d2d252183276 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:45.976605 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d762c-428e-4198-b3b4-d2d252183276 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:45.977125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d762c-428e-4198-b3b4-d2d252183276 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:45.980135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 159/302] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:45.986138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4cc1-7139-4e5e-941c-6acf34165c67 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:45.986836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4cc1-7139-4e5e-941c-6acf34165c67 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:45.987317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4cc1-7139-4e5e-941c-6acf34165c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:45.992526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 144/303] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:46.010775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-564e4cc1-7139-4e5e-941c-6acf34165c67 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:46.012313 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-564e4cc1-7139-4e5e-941c-6acf34165c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:46.012421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3d73e-afce-492f-ad90-bb0e76d950fc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:46.028710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:46.087968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 160/304] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:46.110589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e4cc1-7139-4e5e-941c-6acf34165c67 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:46.129552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3d73e-afce-492f-ad90-bb0e76d950fc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:46.173594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe665c3-00e9-4013-ba7a-efec25335183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:46.174397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe665c3-00e9-4013-ba7a-efec25335183 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:46.174678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe665c3-00e9-4013-ba7a-efec25335183 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:46.174948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe665c3-00e9-4013-ba7a-efec25335183 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:46.185825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe665c3-00e9-4013-ba7a-efec25335183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6fe665c3-00e9-4013-ba7a-efec25335183 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:46.193890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:46.194804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:46.195619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 145/305] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:17:46.203044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe665c3-00e9-4013-ba7a-efec25335183 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:46.223875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e4cc1-7139-4e5e-941c-6acf34165c67 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:46.239067 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:46.262693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8a051-504d-428d-9e4e-a17a9fdd3140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:46.263544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8a051-504d-428d-9e4e-a17a9fdd3140 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:46.263894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8a051-504d-428d-9e4e-a17a9fdd3140 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:46.264124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8a051-504d-428d-9e4e-a17a9fdd3140 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:46.265315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8a051-504d-428d-9e4e-a17a9fdd3140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:46.266746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8a051-504d-428d-9e4e-a17a9fdd3140 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:46.273260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 161/306] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:46.274090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8a051-504d-428d-9e4e-a17a9fdd3140 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:46.297188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:46.338615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe665c3-00e9-4013-ba7a-efec25335183 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:46.374110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5955c-c4ee-4840-a51e-36de8c62a0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:46.374762 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5955c-c4ee-4840-a51e-36de8c62a0bb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:46.375038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5955c-c4ee-4840-a51e-36de8c62a0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:46.375307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5955c-c4ee-4840-a51e-36de8c62a0bb None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:46.376238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5955c-c4ee-4840-a51e-36de8c62a0bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:46.376345 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5955c-c4ee-4840-a51e-36de8c62a0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:46.377761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5955c-c4ee-4840-a51e-36de8c62a0bb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:46.391350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 146/307] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:46.392223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5955c-c4ee-4840-a51e-36de8c62a0bb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:46.399210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8a051-504d-428d-9e4e-a17a9fdd3140 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:46.440803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f0a18-911b-48e8-a7b6-0d7ff03d87d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:46.443755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f0a18-911b-48e8-a7b6-0d7ff03d87d9 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:46.443957 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f0a18-911b-48e8-a7b6-0d7ff03d87d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:46.444262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f0a18-911b-48e8-a7b6-0d7ff03d87d9 None admin] PATH_INFO: `/v3/groups` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:46.445028 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f0a18-911b-48e8-a7b6-0d7ff03d87d9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:46.446469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f0a18-911b-48e8-a7b6-0d7ff03d87d9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:46.469445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 162/308] 10.222.0.30 () {60 vars in 1134 bytes} [Wed Jul 6 20:17:46 2022] POST /identity/v3/groups => generated 229 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:46.511484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5955c-c4ee-4840-a51e-36de8c62a0bb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:46.551517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a991bb-4835-4466-8e05-dcb8f430a079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:46.552890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a991bb-4835-4466-8e05-dcb8f430a079 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:46.553403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a991bb-4835-4466-8e05-dcb8f430a079 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:46.553988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a991bb-4835-4466-8e05-dcb8f430a079 None admin] PATH_INFO: `/v3/users/2aa5d37aeb4f4709ace90b821ef27734` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:46.556599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:46.570658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a991bb-4835-4466-8e05-dcb8f430a079 None admin] RBAC: Authorizing `identity:get_user(user_id=2aa5d37aeb4f4709ace90b821ef27734)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:46.572200 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a991bb-4835-4466-8e05-dcb8f430a079 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:46.574339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 147/309] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:46 2022] GET /identity/v3/users/2aa5d37aeb4f4709ace90b821ef27734 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:46.579999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f0a18-911b-48e8-a7b6-0d7ff03d87d9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:46.638388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:46.702011 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f0a18-911b-48e8-a7b6-0d7ff03d87d9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:46.740036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b1769-08e4-4606-adfb-628feac4f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:46.741107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b1769-08e4-4606-adfb-628feac4f890 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:46.741739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b1769-08e4-4606-adfb-628feac4f890 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:46.742209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b1769-08e4-4606-adfb-628feac4f890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:46.743237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b1769-08e4-4606-adfb-628feac4f890 None admin] RBAC: Adding query filter params (role.id=11fdf15006214f86a22373ac8ad9db18, user.id=2aa5d37aeb4f4709ace90b821ef27734, scope.system=all) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:46.743762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b1769-08e4-4606-adfb-628feac4f890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:46.745420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b1769-08e4-4606-adfb-628feac4f890 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:46.751515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 163/310] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Jul 6 20:17:46 2022] GET /identity/v3/role_assignments?user.id=2aa5d37aeb4f4709ace90b821ef27734&scope.system=all&role.id=11fdf15006214f86a22373ac8ad9db18 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:46.826487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7e142-7a62-4964-a38a-0025e3052c38 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:46.827423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7e142-7a62-4964-a38a-0025e3052c38 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:46.827958 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7e142-7a62-4964-a38a-0025e3052c38 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:46.830036 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 148/311] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:46.838936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400867ce-844a-49b4-8e03-2dbbd1e33a6b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:46.839226 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400867ce-844a-49b4-8e03-2dbbd1e33a6b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:46.839500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400867ce-844a-49b4-8e03-2dbbd1e33a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:46.857818 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-400867ce-844a-49b4-8e03-2dbbd1e33a6b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:46.859025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-400867ce-844a-49b4-8e03-2dbbd1e33a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:46.933857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 164/312] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:46.956256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7e142-7a62-4964-a38a-0025e3052c38 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:47.058329 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7e142-7a62-4964-a38a-0025e3052c38 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:47.098923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15050247-f28b-463a-8d65-6b33032747c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:47.099734 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15050247-f28b-463a-8d65-6b33032747c3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:47.100015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15050247-f28b-463a-8d65-6b33032747c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:47.100293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15050247-f28b-463a-8d65-6b33032747c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:47.111277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15050247-f28b-463a-8d65-6b33032747c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-15050247-f28b-463a-8d65-6b33032747c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:47.119315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:47.120190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:47.120997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 149/313] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:47.126472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400867ce-844a-49b4-8e03-2dbbd1e33a6b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:47.164555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:47.231053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400867ce-844a-49b4-8e03-2dbbd1e33a6b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:47.265470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022208d1-2c87-4e05-95fd-499e117a5ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:47.266245 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022208d1-2c87-4e05-95fd-499e117a5ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:47.266524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022208d1-2c87-4e05-95fd-499e117a5ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:47.266797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022208d1-2c87-4e05-95fd-499e117a5ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:47.267551 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022208d1-2c87-4e05-95fd-499e117a5ba0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:47.267855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022208d1-2c87-4e05-95fd-499e117a5ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:47.269274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022208d1-2c87-4e05-95fd-499e117a5ba0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:47.278204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 165/314] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:47.283530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15050247-f28b-463a-8d65-6b33032747c3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:47.336103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:47.382408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15050247-f28b-463a-8d65-6b33032747c3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:47.415106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b0df5-969c-4d3a-83cf-dffae581d248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:47.416009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b0df5-969c-4d3a-83cf-dffae581d248 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:47.416291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b0df5-969c-4d3a-83cf-dffae581d248 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:47.416618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b0df5-969c-4d3a-83cf-dffae581d248 None admin] PATH_INFO: `/v3/users/f574866cc8794b51a926dea32ae39fcf` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:47.417937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b0df5-969c-4d3a-83cf-dffae581d248 None admin] RBAC: Authorizing `identity:get_user(user_id=f574866cc8794b51a926dea32ae39fcf)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:47.419454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b0df5-969c-4d3a-83cf-dffae581d248 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:47.421811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 150/315] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:47 2022] GET /identity/v3/users/f574866cc8794b51a926dea32ae39fcf => generated 297 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:47.427349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022208d1-2c87-4e05-95fd-499e117a5ba0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:47.526527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:47.530418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022208d1-2c87-4e05-95fd-499e117a5ba0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:47.564562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c07c-d679-4749-a4f7-ba4b7a733b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:47.565240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c07c-d679-4749-a4f7-ba4b7a733b79 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:47.565520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c07c-d679-4749-a4f7-ba4b7a733b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:47.565791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c07c-d679-4749-a4f7-ba4b7a733b79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:47.634190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7c07c-d679-4749-a4f7-ba4b7a733b79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:47.635655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7c07c-d679-4749-a4f7-ba4b7a733b79 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:47.737808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:47.747928 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b0df5-969c-4d3a-83cf-dffae581d248 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:47.750690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 166/316] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:47.851073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b0df5-969c-4d3a-83cf-dffae581d248 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:47.871572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:47.887516 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26923007-1e90-4201-b6e1-5d30fed5c64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:47.888454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923007-1e90-4201-b6e1-5d30fed5c64c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:47.888734 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923007-1e90-4201-b6e1-5d30fed5c64c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:47.889030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923007-1e90-4201-b6e1-5d30fed5c64c None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:47.890278 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26923007-1e90-4201-b6e1-5d30fed5c64c None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:47.891783 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26923007-1e90-4201-b6e1-5d30fed5c64c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:47.893688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 151/317] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:47 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:47.899559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c07c-d679-4749-a4f7-ba4b7a733b79 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:48.002809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c07c-d679-4749-a4f7-ba4b7a733b79 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:48.037520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0c90b-f8d5-4ca2-b385-ad2b4ae45376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:48.038188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0c90b-f8d5-4ca2-b385-ad2b4ae45376 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.038522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0c90b-f8d5-4ca2-b385-ad2b4ae45376 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.038792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0c90b-f8d5-4ca2-b385-ad2b4ae45376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.039685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0c90b-f8d5-4ca2-b385-ad2b4ae45376 None admin] RBAC: Adding query filter params (role.id=11fdf15006214f86a22373ac8ad9db18, scope.project.id=4677125e96014a6faa77a144d1e31495, user.id=f574866cc8794b51a926dea32ae39fcf) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:48.040000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0c90b-f8d5-4ca2-b385-ad2b4ae45376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:48.041520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0c90b-f8d5-4ca2-b385-ad2b4ae45376 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:48.047433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 167/318] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:17:47 2022] GET /identity/v3/role_assignments?user.id=f574866cc8794b51a926dea32ae39fcf&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=11fdf15006214f86a22373ac8ad9db18 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:48.126354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490389-3ba5-4cdc-a77d-8061b4dd0a7c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.126637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490389-3ba5-4cdc-a77d-8061b4dd0a7c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.126818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490389-3ba5-4cdc-a77d-8061b4dd0a7c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.128584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 152/319] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:48.134745 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cc449-e8f9-48d1-af9e-2b4d4d8685e8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.135033 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cc449-e8f9-48d1-af9e-2b4d4d8685e8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.135311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cc449-e8f9-48d1-af9e-2b4d4d8685e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.155397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-601cc449-e8f9-48d1-af9e-2b4d4d8685e8 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:48.156607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-601cc449-e8f9-48d1-af9e-2b4d4d8685e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:48.218440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:48.237034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 168/320] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:48.253764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490389-3ba5-4cdc-a77d-8061b4dd0a7c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:48.361350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490389-3ba5-4cdc-a77d-8061b4dd0a7c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:48.395460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e6423-ac2e-4703-a0af-54b065adad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:48.396176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e6423-ac2e-4703-a0af-54b065adad50 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.396456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e6423-ac2e-4703-a0af-54b065adad50 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.396693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e6423-ac2e-4703-a0af-54b065adad50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.407415 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e6423-ac2e-4703-a0af-54b065adad50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-382e6423-ac2e-4703-a0af-54b065adad50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:48.415169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:48.416050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:48.422073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 153/321] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:48.424228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cc449-e8f9-48d1-af9e-2b4d4d8685e8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:48.525721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cc449-e8f9-48d1-af9e-2b4d4d8685e8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:48.559773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7fe41-7738-4725-a976-11ebaed34482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:48.560447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7fe41-7738-4725-a976-11ebaed34482 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.560724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7fe41-7738-4725-a976-11ebaed34482 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.561007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7fe41-7738-4725-a976-11ebaed34482 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.561777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7fe41-7738-4725-a976-11ebaed34482 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:48.562088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7fe41-7738-4725-a976-11ebaed34482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:48.563463 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7fe41-7738-4725-a976-11ebaed34482 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:48.572276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 169/322] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:48.577651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e6423-ac2e-4703-a0af-54b065adad50 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:48.627401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:48.643080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0f4a-f78d-4f54-8d67-816f70fd8720 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.643599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0f4a-f78d-4f54-8d67-816f70fd8720 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.643599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0f4a-f78d-4f54-8d67-816f70fd8720 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.645181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 170/323] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:17:48.650032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc210-2345-411d-836c-89220f141d2b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.650248 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc210-2345-411d-836c-89220f141d2b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.650513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc210-2345-411d-836c-89220f141d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.666873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-563cc210-2345-411d-836c-89220f141d2b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:48.668048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-563cc210-2345-411d-836c-89220f141d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:48.683576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e6423-ac2e-4703-a0af-54b065adad50 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:48.716802 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:48.717627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5369e-45d9-4d98-82a8-60d1b2d5801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:48.718972 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5369e-45d9-4d98-82a8-60d1b2d5801d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.719275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5369e-45d9-4d98-82a8-60d1b2d5801d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.719575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5369e-45d9-4d98-82a8-60d1b2d5801d None admin] PATH_INFO: `/v3/users/8b2dd93ace7e45ea94a778c7214c15bf` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.720822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5369e-45d9-4d98-82a8-60d1b2d5801d None admin] RBAC: Authorizing `identity:get_user(user_id=8b2dd93ace7e45ea94a778c7214c15bf)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:48.722364 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5369e-45d9-4d98-82a8-60d1b2d5801d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:48.724108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 154/324] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:48 2022] GET /identity/v3/users/8b2dd93ace7e45ea94a778c7214c15bf => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:48.729687 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5369e-45d9-4d98-82a8-60d1b2d5801d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:48.744988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 171/325] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:48.759646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cc210-2345-411d-836c-89220f141d2b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:48.831963 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5369e-45d9-4d98-82a8-60d1b2d5801d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:48.848484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:48.860552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cc210-2345-411d-836c-89220f141d2b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:48.866506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e1605-5a81-4f2f-9699-4de1601804ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:48.867201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1605-5a81-4f2f-9699-4de1601804ac None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.867481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1605-5a81-4f2f-9699-4de1601804ac None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.867751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1605-5a81-4f2f-9699-4de1601804ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.868584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e1605-5a81-4f2f-9699-4de1601804ac None admin] RBAC: Adding query filter params (role.id=0997a26e1c354ef5b0c2730f761b47ed, user.id=8b2dd93ace7e45ea94a778c7214c15bf, scope.system=all) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:48.868892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e1605-5a81-4f2f-9699-4de1601804ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:48.870369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e1605-5a81-4f2f-9699-4de1601804ac None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:48.882281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 155/326] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Jul 6 20:17:48 2022] GET /identity/v3/role_assignments?user.id=8b2dd93ace7e45ea94a778c7214c15bf&scope.system=all&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 510 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:48.883514 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c3e5-9dcd-4003-a9f6-86bf4c6a1ff1 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.883798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c3e5-9dcd-4003-a9f6-86bf4c6a1ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.884069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c3e5-9dcd-4003-a9f6-86bf4c6a1ff1 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.885552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 156/327] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:48.891213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d13bd-e5a3-4291-997f-f88c6f891012 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.891510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d13bd-e5a3-4291-997f-f88c6f891012 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.891758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d13bd-e5a3-4291-997f-f88c6f891012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.898785 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b707a-39f1-4b20-8772-0fbf8c8985e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:48.899623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b707a-39f1-4b20-8772-0fbf8c8985e5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:48.899902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b707a-39f1-4b20-8772-0fbf8c8985e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:48.900230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b707a-39f1-4b20-8772-0fbf8c8985e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:48.901579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b707a-39f1-4b20-8772-0fbf8c8985e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:48.903082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b707a-39f1-4b20-8772-0fbf8c8985e5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:48.905004 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 172/328] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:17:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:48.910938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b707a-39f1-4b20-8772-0fbf8c8985e5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:48.911139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-485d13bd-e5a3-4291-997f-f88c6f891012 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:48.912394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-485d13bd-e5a3-4291-997f-f88c6f891012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:48.970571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:48.996986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 157/329] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:49.009651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d13bd-e5a3-4291-997f-f88c6f891012 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:49.034837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b707a-39f1-4b20-8772-0fbf8c8985e5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:49.072768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e5e40-bd70-4691-9d78-b05f71eece95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:49.073494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e5e40-bd70-4691-9d78-b05f71eece95 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:49.073775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e5e40-bd70-4691-9d78-b05f71eece95 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:49.074049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e5e40-bd70-4691-9d78-b05f71eece95 None admin] PATH_INFO: `/v3/groups` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:49.074784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e5e40-bd70-4691-9d78-b05f71eece95 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:49.076225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e5e40-bd70-4691-9d78-b05f71eece95 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:49.095571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 173/330] 10.222.0.30 () {60 vars in 1134 bytes} [Wed Jul 6 20:17:48 2022] POST /identity/v3/groups => generated 226 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:17:49.133096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d13bd-e5a3-4291-997f-f88c6f891012 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:49.135782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:49.170269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0521e-27b9-460d-a299-b9cc1413b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:49.170992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0521e-27b9-460d-a299-b9cc1413b219 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:49.171273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0521e-27b9-460d-a299-b9cc1413b219 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:49.171549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0521e-27b9-460d-a299-b9cc1413b219 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:49.183623 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0521e-27b9-460d-a299-b9cc1413b219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ccc0521e-27b9-460d-a299-b9cc1413b219 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:49.191598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:49.192565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:49.193602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 158/331] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:49.199195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e5e40-bd70-4691-9d78-b05f71eece95 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:49.304999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e5e40-bd70-4691-9d78-b05f71eece95 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:49.319314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:49.342907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af98b-9d40-4474-b9a5-1656d0911fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:49.343594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af98b-9d40-4474-b9a5-1656d0911fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:49.343876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af98b-9d40-4474-b9a5-1656d0911fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:49.344148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af98b-9d40-4474-b9a5-1656d0911fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:49.344910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3af98b-9d40-4474-b9a5-1656d0911fc0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:49.345264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3af98b-9d40-4474-b9a5-1656d0911fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:49.346644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3af98b-9d40-4474-b9a5-1656d0911fc0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:49.356216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 174/332] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:49.361900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0521e-27b9-460d-a299-b9cc1413b219 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:49.473152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0521e-27b9-460d-a299-b9cc1413b219 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:49.510772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d12150-7975-451c-9ba7-b40bf10b6323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:49.511653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d12150-7975-451c-9ba7-b40bf10b6323 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:49.511931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d12150-7975-451c-9ba7-b40bf10b6323 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:49.512202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d12150-7975-451c-9ba7-b40bf10b6323 None admin] PATH_INFO: `/v3/users/2aa5d37aeb4f4709ace90b821ef27734` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:49.513444 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d12150-7975-451c-9ba7-b40bf10b6323 None admin] RBAC: Authorizing `identity:get_user(user_id=2aa5d37aeb4f4709ace90b821ef27734)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:49.514938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d12150-7975-451c-9ba7-b40bf10b6323 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:49.516908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 159/333] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:49 2022] GET /identity/v3/users/2aa5d37aeb4f4709ace90b821ef27734 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:49.523171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af98b-9d40-4474-b9a5-1656d0911fc0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:49.627877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af98b-9d40-4474-b9a5-1656d0911fc0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:49.663821 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28f22e-c0c2-4910-adc0-2e7e2f2258d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:49.664739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f22e-c0c2-4910-adc0-2e7e2f2258d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:49.665117 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f22e-c0c2-4910-adc0-2e7e2f2258d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:49.665294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f22e-c0c2-4910-adc0-2e7e2f2258d6 None admin] PATH_INFO: `/v3/system/users/2aa5d37aeb4f4709ace90b821ef27734/roles/11fdf15006214f86a22373ac8ad9db18` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:49.667165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28f22e-c0c2-4910-adc0-2e7e2f2258d6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2aa5d37aeb4f4709ace90b821ef27734, role_id=11fdf15006214f86a22373ac8ad9db18)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:49.669350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28f22e-c0c2-4910-adc0-2e7e2f2258d6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:49.679695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 175/334] 10.222.0.30 () {58 vars in 1334 bytes} [Wed Jul 6 20:17:49 2022] PUT /identity/v3/system/users/2aa5d37aeb4f4709ace90b821ef27734/roles/11fdf15006214f86a22373ac8ad9db18 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:17:51.266690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430b45c-a74c-4506-a4f5-2720682de1c9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:51.267229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430b45c-a74c-4506-a4f5-2720682de1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:51.267506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430b45c-a74c-4506-a4f5-2720682de1c9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:51.269276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 160/335] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:51.274509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fa5bd-566b-4852-a375-c534a775e910 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:51.274943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fa5bd-566b-4852-a375-c534a775e910 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:51.275146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fa5bd-566b-4852-a375-c534a775e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:51.295610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-219fa5bd-566b-4852-a375-c534a775e910 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:51.296796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-219fa5bd-566b-4852-a375-c534a775e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:51.327619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:51.383889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 176/336] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:51.430752 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430b45c-a74c-4506-a4f5-2720682de1c9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:51.466657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:51.554034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430b45c-a74c-4506-a4f5-2720682de1c9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:51.596449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d34e9-6ac9-4706-9d7c-740877168298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:51.597277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d34e9-6ac9-4706-9d7c-740877168298 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:51.597552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d34e9-6ac9-4706-9d7c-740877168298 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:51.597823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d34e9-6ac9-4706-9d7c-740877168298 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:51.610737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d34e9-6ac9-4706-9d7c-740877168298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-746d34e9-6ac9-4706-9d7c-740877168298 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:51.618459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:51.619359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:51.620141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 161/337] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:51.625676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fa5bd-566b-4852-a375-c534a775e910 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:51.687178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9f77f-f762-467e-a637-1c9a6f1639c8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:51.687442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9f77f-f762-467e-a637-1c9a6f1639c8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:51.687719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9f77f-f762-467e-a637-1c9a6f1639c8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:51.689796 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 162/338] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:51.696400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c2ee-1847-43f7-a561-813822f33a08 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:51.696731 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c2ee-1847-43f7-a561-813822f33a08 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:51.697027 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c2ee-1847-43f7-a561-813822f33a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:51.730867 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8679c2ee-1847-43f7-a561-813822f33a08 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:51.733691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8679c2ee-1847-43f7-a561-813822f33a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:51.780519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fa5bd-566b-4852-a375-c534a775e910 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:51.832080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86728e8-206c-49fd-8fd8-3b4c2b6f0e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:51.832773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86728e8-206c-49fd-8fd8-3b4c2b6f0e87 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:51.833090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86728e8-206c-49fd-8fd8-3b4c2b6f0e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:51.833369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86728e8-206c-49fd-8fd8-3b4c2b6f0e87 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:51.834144 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86728e8-206c-49fd-8fd8-3b4c2b6f0e87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:51.834453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86728e8-206c-49fd-8fd8-3b4c2b6f0e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:51.835903 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86728e8-206c-49fd-8fd8-3b4c2b6f0e87 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:51.847145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 177/339] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:51.848605 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8cb9a-2ddf-4b0d-9230-16eda2733cd6 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:51.849115 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8cb9a-2ddf-4b0d-9230-16eda2733cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:51.849525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8cb9a-2ddf-4b0d-9230-16eda2733cd6 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:51.855293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 178/340] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:51.857237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8cb9a-2ddf-4b0d-9230-16eda2733cd6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:51.897466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 163/341] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:51.898849 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006817-ca84-412a-8fef-bbb9375e2955 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:51.899136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006817-ca84-412a-8fef-bbb9375e2955 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:51.899412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006817-ca84-412a-8fef-bbb9375e2955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:51.914023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:51.942013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5e006817-ca84-412a-8fef-bbb9375e2955 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:51.943206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5e006817-ca84-412a-8fef-bbb9375e2955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:51.985303 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:52.002659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8cb9a-2ddf-4b0d-9230-16eda2733cd6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:52.039749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 164/342] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:52.040746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e006817-ca84-412a-8fef-bbb9375e2955 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:52.053357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c7b32-e673-4418-8449-4e1d6590678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:52.054385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c7b32-e673-4418-8449-4e1d6590678a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:52.054807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c7b32-e673-4418-8449-4e1d6590678a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:52.055218 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c7b32-e673-4418-8449-4e1d6590678a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:52.149817 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c7b32-e673-4418-8449-4e1d6590678a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:52.151681 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c7b32-e673-4418-8449-4e1d6590678a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:52.188401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e006817-ca84-412a-8fef-bbb9375e2955 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:52.193537 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:52.240576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2256a-124b-4411-92d4-271413193c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:52.241862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2256a-124b-4411-92d4-271413193c76 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:52.242286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2256a-124b-4411-92d4-271413193c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:52.242788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2256a-124b-4411-92d4-271413193c76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:52.253977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2256a-124b-4411-92d4-271413193c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-21a2256a-124b-4411-92d4-271413193c76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:52.264026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:52.264981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:52.265778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:52.268558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 165/343] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:17:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:52.270102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2256a-124b-4411-92d4-271413193c76 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:52.289466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:52.313781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 179/344] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:17:52.314646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c7b32-e673-4418-8449-4e1d6590678a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:52.381273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2256a-124b-4411-92d4-271413193c76 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:52.419460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbbb98-68c7-4992-b51e-2fa39d0a0783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:52.420596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbbb98-68c7-4992-b51e-2fa39d0a0783 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:52.421098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbbb98-68c7-4992-b51e-2fa39d0a0783 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:52.421547 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbbb98-68c7-4992-b51e-2fa39d0a0783 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:52.432419 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbbb98-68c7-4992-b51e-2fa39d0a0783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e7fbbb98-68c7-4992-b51e-2fa39d0a0783 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:52.441248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:52.442166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:52.443002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:52.445551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 166/345] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:52.446508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbbb98-68c7-4992-b51e-2fa39d0a0783 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:52.473460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c7b32-e673-4418-8449-4e1d6590678a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:52.539129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:52.548769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1acfb-8a54-417b-96eb-5feee8a36bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:52.550435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1acfb-8a54-417b-96eb-5feee8a36bfc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:52.553532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1acfb-8a54-417b-96eb-5feee8a36bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:52.554031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1acfb-8a54-417b-96eb-5feee8a36bfc None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:52.554977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1acfb-8a54-417b-96eb-5feee8a36bfc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:52.555462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1acfb-8a54-417b-96eb-5feee8a36bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:52.557045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1acfb-8a54-417b-96eb-5feee8a36bfc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:52.566776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 180/346] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:17:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:52.568002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1acfb-8a54-417b-96eb-5feee8a36bfc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:52.569936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:52.622434 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbbb98-68c7-4992-b51e-2fa39d0a0783 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:52.677150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b654a76-1bc0-4312-81a7-9218d0ab23c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:52.677961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b654a76-1bc0-4312-81a7-9218d0ab23c0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:52.678245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b654a76-1bc0-4312-81a7-9218d0ab23c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:52.678523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b654a76-1bc0-4312-81a7-9218d0ab23c0 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:52.680210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b654a76-1bc0-4312-81a7-9218d0ab23c0 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:52.681979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b654a76-1bc0-4312-81a7-9218d0ab23c0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:52.684703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 167/347] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:52 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:52.689815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b654a76-1bc0-4312-81a7-9218d0ab23c0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:52.694798 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1acfb-8a54-417b-96eb-5feee8a36bfc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:52.729512 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c72770-4114-4fa9-8fc0-ce03b2d3afc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:52.730497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c72770-4114-4fa9-8fc0-ce03b2d3afc1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:52.730919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c72770-4114-4fa9-8fc0-ce03b2d3afc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:52.731330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c72770-4114-4fa9-8fc0-ce03b2d3afc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:52.732258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c72770-4114-4fa9-8fc0-ce03b2d3afc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:52.732704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c72770-4114-4fa9-8fc0-ce03b2d3afc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:52.734401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c72770-4114-4fa9-8fc0-ce03b2d3afc1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:52.745566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 181/348] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:52.747124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608aacc-1103-4313-a5fe-0c59bb4e20af None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:52.747537 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608aacc-1103-4313-a5fe-0c59bb4e20af None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:52.747933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608aacc-1103-4313-a5fe-0c59bb4e20af None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:52.749775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 182/349] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:52.750797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608aacc-1103-4313-a5fe-0c59bb4e20af None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:52.826078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:52.826536 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b654a76-1bc0-4312-81a7-9218d0ab23c0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:52.864630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6523b9e-f5e9-4be7-b1aa-07ce0ae6f84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:52.865584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523b9e-f5e9-4be7-b1aa-07ce0ae6f84f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:52.866001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523b9e-f5e9-4be7-b1aa-07ce0ae6f84f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:52.866472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523b9e-f5e9-4be7-b1aa-07ce0ae6f84f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:52.874352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608aacc-1103-4313-a5fe-0c59bb4e20af None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:52.878389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:52.912906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42670d57-3bf3-4d7b-b55a-458892f2e081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:52.914201 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670d57-3bf3-4d7b-b55a-458892f2e081 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:52.914630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670d57-3bf3-4d7b-b55a-458892f2e081 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:52.915101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670d57-3bf3-4d7b-b55a-458892f2e081 None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:52.921837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42670d57-3bf3-4d7b-b55a-458892f2e081 None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:52.923592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42670d57-3bf3-4d7b-b55a-458892f2e081 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:52.929138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 183/350] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:17:52 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:52.930219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42670d57-3bf3-4d7b-b55a-458892f2e081 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:52.939965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6523b9e-f5e9-4be7-b1aa-07ce0ae6f84f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:52.941868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6523b9e-f5e9-4be7-b1aa-07ce0ae6f84f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:53.045952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42670d57-3bf3-4d7b-b55a-458892f2e081 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:53.064178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 168/351] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:53.066328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:53.067491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d331b6e-bf86-4d5b-8419-d9ae14e77944 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:53.067971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d331b6e-bf86-4d5b-8419-d9ae14e77944 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:53.068670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d331b6e-bf86-4d5b-8419-d9ae14e77944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:53.087427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce027c-d15e-4df5-9db1-7f03e3618e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:53.088396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce027c-d15e-4df5-9db1-7f03e3618e11 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:53.088703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0d331b6e-bf86-4d5b-8419-d9ae14e77944 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:53.089013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce027c-d15e-4df5-9db1-7f03e3618e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:53.089457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce027c-d15e-4df5-9db1-7f03e3618e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:53.090176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0d331b6e-bf86-4d5b-8419-d9ae14e77944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:53.134760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:53.172238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 169/352] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:53.173457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d331b6e-bf86-4d5b-8419-d9ae14e77944 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:53.180212 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce027c-d15e-4df5-9db1-7f03e3618e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:53.181677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce027c-d15e-4df5-9db1-7f03e3618e11 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:53.286772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d331b6e-bf86-4d5b-8419-d9ae14e77944 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:53.308302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 184/353] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:53.309257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce027c-d15e-4df5-9db1-7f03e3618e11 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:53.330307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:53.333385 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b8af8-7fc9-41f4-b38f-b85c227cba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:53.335809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b8af8-7fc9-41f4-b38f-b85c227cba60 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:53.335809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b8af8-7fc9-41f4-b38f-b85c227cba60 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:53.335809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b8af8-7fc9-41f4-b38f-b85c227cba60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:53.335809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b8af8-7fc9-41f4-b38f-b85c227cba60 None admin] RBAC: Adding query filter params (group.id=dfdcce67e5fa43d38aedd444f9812c8f, role.id=0997a26e1c354ef5b0c2730f761b47ed, scope.project.id=c3623463132749bc9f5eb4efee71c513) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:53.336094 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b8af8-7fc9-41f4-b38f-b85c227cba60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:53.338731 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b8af8-7fc9-41f4-b38f-b85c227cba60 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:53.345896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 170/354] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Jul 6 20:17:53 2022] GET /identity/v3/role_assignments?group.id=dfdcce67e5fa43d38aedd444f9812c8f&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:53.347222 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621cbe-2cca-4b8f-8c8b-569482b15a91 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:53.347508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621cbe-2cca-4b8f-8c8b-569482b15a91 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:53.347780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621cbe-2cca-4b8f-8c8b-569482b15a91 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:53.349189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 171/355] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:53.349768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d621cbe-2cca-4b8f-8c8b-569482b15a91 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:53.392271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:53.439387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce027c-d15e-4df5-9db1-7f03e3618e11 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:53.484162 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7e383-d728-40f0-b939-b23f0f4b2575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:53.486047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7e383-d728-40f0-b939-b23f0f4b2575 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:53.487591 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7e383-d728-40f0-b939-b23f0f4b2575 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:53.487591 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7e383-d728-40f0-b939-b23f0f4b2575 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:53.490440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7e383-d728-40f0-b939-b23f0f4b2575 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:53.490440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7e383-d728-40f0-b939-b23f0f4b2575 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:53.491876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 185/356] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:53 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:53.492485 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7e383-d728-40f0-b939-b23f0f4b2575 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:53.505013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d621cbe-2cca-4b8f-8c8b-569482b15a91 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:53.554212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cd230-5c49-4696-8d06-6cf2446987d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:53.555057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cd230-5c49-4696-8d06-6cf2446987d1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:53.555359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cd230-5c49-4696-8d06-6cf2446987d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:53.555626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cd230-5c49-4696-8d06-6cf2446987d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:53.567088 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cd230-5c49-4696-8d06-6cf2446987d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-bc0cd230-5c49-4696-8d06-6cf2446987d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:53.577113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:53.578031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:53.578807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 172/357] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:53.579933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523a0d3-5ffd-4b81-a3c2-84c472b14fa1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:53.579933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523a0d3-5ffd-4b81-a3c2-84c472b14fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:53.580149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523a0d3-5ffd-4b81-a3c2-84c472b14fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:53.602076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8523a0d3-5ffd-4b81-a3c2-84c472b14fa1 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:53.603268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8523a0d3-5ffd-4b81-a3c2-84c472b14fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:53.604895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:53.626408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7e383-d728-40f0-b939-b23f0f4b2575 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:53.675147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b867430-f027-46d7-adb2-8968fa59405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:53.676504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867430-f027-46d7-adb2-8968fa59405d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:53.677136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867430-f027-46d7-adb2-8968fa59405d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:53.677602 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867430-f027-46d7-adb2-8968fa59405d None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:53.679113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b867430-f027-46d7-adb2-8968fa59405d None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:53.680895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b867430-f027-46d7-adb2-8968fa59405d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:53.683358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 186/358] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:53 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:53.684327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b867430-f027-46d7-adb2-8968fa59405d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:53.687896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 173/359] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:53.689867 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523a0d3-5ffd-4b81-a3c2-84c472b14fa1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:53.734815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:53.832090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b867430-f027-46d7-adb2-8968fa59405d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:53.851603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523a0d3-5ffd-4b81-a3c2-84c472b14fa1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:53.872163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e312a60-d394-4583-9fac-03c7282210fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:53.873069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e312a60-d394-4583-9fac-03c7282210fa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:53.873507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e312a60-d394-4583-9fac-03c7282210fa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:53.873932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e312a60-d394-4583-9fac-03c7282210fa None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:53.876277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e312a60-d394-4583-9fac-03c7282210fa None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:53.877962 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e312a60-d394-4583-9fac-03c7282210fa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:53.880100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 187/360] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:17:53 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:53.881123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e312a60-d394-4583-9fac-03c7282210fa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:53.895541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c564006-7c4f-454d-8679-ddf144823108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:53.895768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c564006-7c4f-454d-8679-ddf144823108 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:53.895994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c564006-7c4f-454d-8679-ddf144823108 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:53.896276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c564006-7c4f-454d-8679-ddf144823108 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:53.897339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c564006-7c4f-454d-8679-ddf144823108 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:53.897697 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c564006-7c4f-454d-8679-ddf144823108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:53.899870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c564006-7c4f-454d-8679-ddf144823108 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:53.909912 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:53.911238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 174/361] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:53.912433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c564006-7c4f-454d-8679-ddf144823108 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:54.000218 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e312a60-d394-4583-9fac-03c7282210fa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:54.029924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:54.044160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70128da9-ee60-44e1-84e7-ffcf8f38fcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:54.045359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70128da9-ee60-44e1-84e7-ffcf8f38fcbd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:54.045817 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70128da9-ee60-44e1-84e7-ffcf8f38fcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:54.046169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c564006-7c4f-454d-8679-ddf144823108 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:54.046329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70128da9-ee60-44e1-84e7-ffcf8f38fcbd None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:54.048101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70128da9-ee60-44e1-84e7-ffcf8f38fcbd None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:54.049784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70128da9-ee60-44e1-84e7-ffcf8f38fcbd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:54.052615 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 188/362] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:17:53 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:54.054160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2c3b4-8960-4d63-9011-c23a4c6df57c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:54.054585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2c3b4-8960-4d63-9011-c23a4c6df57c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:54.055019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2c3b4-8960-4d63-9011-c23a4c6df57c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:54.056400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 189/363] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:54.057251 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2c3b4-8960-4d63-9011-c23a4c6df57c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:54.096949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83defd2-a6d7-4b8e-9384-8e5ca2a322a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:54.097851 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83defd2-a6d7-4b8e-9384-8e5ca2a322a7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:54.098131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83defd2-a6d7-4b8e-9384-8e5ca2a322a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:54.098406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83defd2-a6d7-4b8e-9384-8e5ca2a322a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:54.113324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83defd2-a6d7-4b8e-9384-8e5ca2a322a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a83defd2-a6d7-4b8e-9384-8e5ca2a322a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:54.122023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:54.122987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:54.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 175/364] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:17:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:54.125006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83defd2-a6d7-4b8e-9384-8e5ca2a322a7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:54.167210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:54.181617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2c3b4-8960-4d63-9011-c23a4c6df57c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:54.224751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a25deb-cc01-4cae-8558-89ff3c6fa7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:54.225564 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a25deb-cc01-4cae-8558-89ff3c6fa7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:54.225888 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a25deb-cc01-4cae-8558-89ff3c6fa7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:54.226164 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a25deb-cc01-4cae-8558-89ff3c6fa7b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:54.227002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a25deb-cc01-4cae-8558-89ff3c6fa7b2 None admin] RBAC: Adding query filter params (group.id=dfdcce67e5fa43d38aedd444f9812c8f, role.id=ce1cbac653a64c268855a459ce0aae34, scope.project.id=c3623463132749bc9f5eb4efee71c513) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:54.227308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a25deb-cc01-4cae-8558-89ff3c6fa7b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:54.228754 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a25deb-cc01-4cae-8558-89ff3c6fa7b2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:54.237037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 190/365] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Jul 6 20:17:54 2022] GET /identity/v3/role_assignments?group.id=dfdcce67e5fa43d38aedd444f9812c8f&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=ce1cbac653a64c268855a459ce0aae34 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:54.237037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c904a2-b282-4abe-b6af-4e382b430842 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:54.237037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c904a2-b282-4abe-b6af-4e382b430842 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:54.237037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c904a2-b282-4abe-b6af-4e382b430842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:54.258954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e8c904a2-b282-4abe-b6af-4e382b430842 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:54.260087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e8c904a2-b282-4abe-b6af-4e382b430842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:54.275586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83defd2-a6d7-4b8e-9384-8e5ca2a322a7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:54.329356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4ee6-ddf4-47d7-b8a4-ea91b2525ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:54.330272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4ee6-ddf4-47d7-b8a4-ea91b2525ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:54.330546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4ee6-ddf4-47d7-b8a4-ea91b2525ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:54.330817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4ee6-ddf4-47d7-b8a4-ea91b2525ad4 None admin] PATH_INFO: `/v3/users/2aa5d37aeb4f4709ace90b821ef27734` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:54.332232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea4ee6-ddf4-47d7-b8a4-ea91b2525ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=2aa5d37aeb4f4709ace90b821ef27734)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:54.333840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea4ee6-ddf4-47d7-b8a4-ea91b2525ad4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:54.335727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 176/366] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:17:54 2022] GET /identity/v3/users/2aa5d37aeb4f4709ace90b821ef27734 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:54.336594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4ee6-ddf4-47d7-b8a4-ea91b2525ad4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:54.352097 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 191/367] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:54.358090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c904a2-b282-4abe-b6af-4e382b430842 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:54.359471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:54.471519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4ee6-ddf4-47d7-b8a4-ea91b2525ad4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:54.472410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:54.491880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c904a2-b282-4abe-b6af-4e382b430842 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:54.527007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e100a54-5cf3-4bdb-82b4-aaeb9740305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:54.527643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e100a54-5cf3-4bdb-82b4-aaeb9740305a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:54.527923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e100a54-5cf3-4bdb-82b4-aaeb9740305a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:54.528194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e100a54-5cf3-4bdb-82b4-aaeb9740305a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:54.531220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e100a54-5cf3-4bdb-82b4-aaeb9740305a None admin] RBAC: Adding query filter params (group.id=dfdcce67e5fa43d38aedd444f9812c8f, role.id=0997a26e1c354ef5b0c2730f761b47ed, scope.project.id=4677125e96014a6faa77a144d1e31495) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:54.531422 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e100a54-5cf3-4bdb-82b4-aaeb9740305a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:54.532936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e100a54-5cf3-4bdb-82b4-aaeb9740305a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:54.539861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 177/368] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Jul 6 20:17:54 2022] GET /identity/v3/role_assignments?group.id=dfdcce67e5fa43d38aedd444f9812c8f&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:54.540678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e100a54-5cf3-4bdb-82b4-aaeb9740305a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:54.544025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4d4e-ed8e-4f7c-b486-f2a3bc46259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:54.545064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4d4e-ed8e-4f7c-b486-f2a3bc46259a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:54.545888 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4d4e-ed8e-4f7c-b486-f2a3bc46259a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:54.547425 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4d4e-ed8e-4f7c-b486-f2a3bc46259a None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:54.548494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b4d4e-ed8e-4f7c-b486-f2a3bc46259a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:54.549044 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b4d4e-ed8e-4f7c-b486-f2a3bc46259a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:54.550717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b4d4e-ed8e-4f7c-b486-f2a3bc46259a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:54.562347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 192/369] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:17:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:54.563424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4d4e-ed8e-4f7c-b486-f2a3bc46259a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:54.671904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:54.697490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4d4e-ed8e-4f7c-b486-f2a3bc46259a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:54.704851 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e100a54-5cf3-4bdb-82b4-aaeb9740305a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:54.741506 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d2c8-9416-434b-bc6f-8c4bba30290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:54.742741 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d2c8-9416-434b-bc6f-8c4bba30290c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:54.743176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d2c8-9416-434b-bc6f-8c4bba30290c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:54.743505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d2c8-9416-434b-bc6f-8c4bba30290c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:54.745085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d943e-6175-4fdd-b28b-3f01773ea914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:54.745813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d943e-6175-4fdd-b28b-3f01773ea914 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:54.746153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d943e-6175-4fdd-b28b-3f01773ea914 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:54.746486 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d943e-6175-4fdd-b28b-3f01773ea914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:54.747395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d943e-6175-4fdd-b28b-3f01773ea914 None admin] RBAC: Adding query filter params (role.id=11fdf15006214f86a22373ac8ad9db18, user.id=2aa5d37aeb4f4709ace90b821ef27734, scope.system=all) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:54.747767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d943e-6175-4fdd-b28b-3f01773ea914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:54.749305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d943e-6175-4fdd-b28b-3f01773ea914 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:54.755841 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1d2c8-9416-434b-bc6f-8c4bba30290c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:54.763638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 178/370] 10.222.0.30 () {56 vars in 1308 bytes} [Wed Jul 6 20:17:54 2022] GET /identity/v3/role_assignments?user.id=2aa5d37aeb4f4709ace90b821ef27734&scope.system=all&role.id=11fdf15006214f86a22373ac8ad9db18 => generated 510 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:54.764531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d943e-6175-4fdd-b28b-3f01773ea914 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c0a1d2c8-9416-434b-bc6f-8c4bba30290c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:54.764643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:54.765617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:54.766943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 193/371] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:17:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:54.780794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d2c8-9416-434b-bc6f-8c4bba30290c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:54.801361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:54.919279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d943e-6175-4fdd-b28b-3f01773ea914 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:54.987269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3454a-ff5f-4c1a-b0b9-3d2fef14a289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:54.988006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3454a-ff5f-4c1a-b0b9-3d2fef14a289 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:54.988290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3454a-ff5f-4c1a-b0b9-3d2fef14a289 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:54.988617 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3454a-ff5f-4c1a-b0b9-3d2fef14a289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:54.998046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:55.043016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d2c8-9416-434b-bc6f-8c4bba30290c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:55.091276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7f808-2d54-4077-aec4-ed591f50fb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:55.091960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f808-2d54-4077-aec4-ed591f50fb24 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:55.092242 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f808-2d54-4077-aec4-ed591f50fb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:55.092516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f808-2d54-4077-aec4-ed591f50fb24 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:55.093321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7f808-2d54-4077-aec4-ed591f50fb24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:55.093632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7f808-2d54-4077-aec4-ed591f50fb24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:55.095029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7f808-2d54-4077-aec4-ed591f50fb24 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:55.106682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3454a-ff5f-4c1a-b0b9-3d2fef14a289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:55.108171 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3454a-ff5f-4c1a-b0b9-3d2fef14a289 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:55.119304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 194/372] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:55.128027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7f808-2d54-4077-aec4-ed591f50fb24 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:55.220172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:55.230788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 179/373] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:55.237265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3454a-ff5f-4c1a-b0b9-3d2fef14a289 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:55.265909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7f808-2d54-4077-aec4-ed591f50fb24 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:55.299478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:55.308074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bc77d-47f7-4de0-b612-5704d0f96fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:55.309368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bc77d-47f7-4de0-b612-5704d0f96fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:55.309852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bc77d-47f7-4de0-b612-5704d0f96fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:55.310337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bc77d-47f7-4de0-b612-5704d0f96fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:55.379977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3454a-ff5f-4c1a-b0b9-3d2fef14a289 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:55.424002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843f0e9-8359-4a0f-8925-eaf54a182ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:55.425756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843f0e9-8359-4a0f-8925-eaf54a182ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:55.426249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843f0e9-8359-4a0f-8925-eaf54a182ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:55.426721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843f0e9-8359-4a0f-8925-eaf54a182ce4 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:55.429127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843f0e9-8359-4a0f-8925-eaf54a182ce4 None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:55.431271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843f0e9-8359-4a0f-8925-eaf54a182ce4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:55.433534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 180/374] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:55 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:55.438720 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843f0e9-8359-4a0f-8925-eaf54a182ce4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:55.500800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bc77d-47f7-4de0-b612-5704d0f96fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:55.502104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bc77d-47f7-4de0-b612-5704d0f96fd7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:55.555014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843f0e9-8359-4a0f-8925-eaf54a182ce4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:55.558282 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:55.603915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce55957-4089-40ef-a62e-c5b9419a23bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:55.604796 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce55957-4089-40ef-a62e-c5b9419a23bf None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:55.605106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce55957-4089-40ef-a62e-c5b9419a23bf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:55.605385 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce55957-4089-40ef-a62e-c5b9419a23bf None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:55.607327 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce55957-4089-40ef-a62e-c5b9419a23bf None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:55.608776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce55957-4089-40ef-a62e-c5b9419a23bf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:55.615702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 181/375] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:17:55 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:55.621058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce55957-4089-40ef-a62e-c5b9419a23bf None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:55.651495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:55.693553 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 195/376] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:17:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:17:55.698641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bc77d-47f7-4de0-b612-5704d0f96fd7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:55.787150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce55957-4089-40ef-a62e-c5b9419a23bf None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:55.816778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bc77d-47f7-4de0-b612-5704d0f96fd7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:55.857629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1defc-bb7e-4f23-95d8-dc88c4df923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:55.858493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1defc-bb7e-4f23-95d8-dc88c4df923b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:55.858756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1defc-bb7e-4f23-95d8-dc88c4df923b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:55.859021 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1defc-bb7e-4f23-95d8-dc88c4df923b None admin] PATH_INFO: `/v3/projects/b9dceb457eba4f588d26a4848fffb9ba` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:55.861554 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e593e5-077c-48da-a2a3-def322e8cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:55.862469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e593e5-077c-48da-a2a3-def322e8cb69 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:55.862925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e593e5-077c-48da-a2a3-def322e8cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:55.863383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e593e5-077c-48da-a2a3-def322e8cb69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:55.864410 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e593e5-077c-48da-a2a3-def322e8cb69 None admin] RBAC: Adding query filter params (group.id=dfdcce67e5fa43d38aedd444f9812c8f, role.id=ce1cbac653a64c268855a459ce0aae34, scope.project.id=4677125e96014a6faa77a144d1e31495) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:55.864900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e593e5-077c-48da-a2a3-def322e8cb69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:55.865699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1defc-bb7e-4f23-95d8-dc88c4df923b None admin] RBAC: Authorizing `identity:get_project(project_id=b9dceb457eba4f588d26a4848fffb9ba)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:55.866894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e593e5-077c-48da-a2a3-def322e8cb69 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:55.867269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1defc-bb7e-4f23-95d8-dc88c4df923b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:55.869324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 196/377] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:55 2022] GET /identity/v3/projects/b9dceb457eba4f588d26a4848fffb9ba => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:55.874127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 182/378] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Jul 6 20:17:55 2022] GET /identity/v3/role_assignments?group.id=dfdcce67e5fa43d38aedd444f9812c8f&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=ce1cbac653a64c268855a459ce0aae34 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:55.877071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1defc-bb7e-4f23-95d8-dc88c4df923b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:55.907263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e3db-d5e6-41fc-b958-7a5e921e990b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:55.907861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e3db-d5e6-41fc-b958-7a5e921e990b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:55.908319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e3db-d5e6-41fc-b958-7a5e921e990b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:55.910241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 183/379] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:17:55.936857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:55.947187 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa278cf7-ea7e-40a6-ae08-ad17d322ef1a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:55.947762 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa278cf7-ea7e-40a6-ae08-ad17d322ef1a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:55.948290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa278cf7-ea7e-40a6-ae08-ad17d322ef1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:55.973615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fa278cf7-ea7e-40a6-ae08-ad17d322ef1a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:55.975640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fa278cf7-ea7e-40a6-ae08-ad17d322ef1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:56.017118 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:56.060036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1defc-bb7e-4f23-95d8-dc88c4df923b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:56.068862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 184/380] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:56.120178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ef730-c163-4666-a1cc-9b719a7cc200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:56.121107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ef730-c163-4666-a1cc-9b719a7cc200 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:56.121448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ef730-c163-4666-a1cc-9b719a7cc200 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:56.121728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ef730-c163-4666-a1cc-9b719a7cc200 None admin] PATH_INFO: `/v3/groups/49f0170fb261477dac87d0cbc04fd101` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:56.123706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa278cf7-ea7e-40a6-ae08-ad17d322ef1a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:56.127904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ef730-c163-4666-a1cc-9b719a7cc200 None admin] RBAC: Authorizing `identity:get_group(group_id=49f0170fb261477dac87d0cbc04fd101)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:56.129450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ef730-c163-4666-a1cc-9b719a7cc200 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:56.131516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 197/381] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:17:55 2022] GET /identity/v3/groups/49f0170fb261477dac87d0cbc04fd101 => generated 229 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:56.138025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ef730-c163-4666-a1cc-9b719a7cc200 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:56.244831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:56.249935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ef730-c163-4666-a1cc-9b719a7cc200 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:56.291211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93752d13-a633-49ff-a0cc-c8e483712d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:56.292270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93752d13-a633-49ff-a0cc-c8e483712d6a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:56.292745 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93752d13-a633-49ff-a0cc-c8e483712d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:56.293369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93752d13-a633-49ff-a0cc-c8e483712d6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:56.295444 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93752d13-a633-49ff-a0cc-c8e483712d6a None admin] RBAC: Adding query filter params (group.id=49f0170fb261477dac87d0cbc04fd101, role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=b9dceb457eba4f588d26a4848fffb9ba) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:56.296130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93752d13-a633-49ff-a0cc-c8e483712d6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:56.298922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93752d13-a633-49ff-a0cc-c8e483712d6a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:56.309995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 198/382] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Jul 6 20:17:56 2022] GET /identity/v3/role_assignments?group.id=49f0170fb261477dac87d0cbc04fd101&scope.project.id=b9dceb457eba4f588d26a4848fffb9ba&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:56.321714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa278cf7-ea7e-40a6-ae08-ad17d322ef1a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:56.366910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd59f69-e7e7-49c9-84ab-9be412cb1a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:56.368149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59f69-e7e7-49c9-84ab-9be412cb1a6e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:56.368652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59f69-e7e7-49c9-84ab-9be412cb1a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:56.369156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59f69-e7e7-49c9-84ab-9be412cb1a6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:56.394069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd59f69-e7e7-49c9-84ab-9be412cb1a6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ffd59f69-e7e7-49c9-84ab-9be412cb1a6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:56.402935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:56.403895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:56.404724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:56.407646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 185/383] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:17:56.413530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93752d13-a633-49ff-a0cc-c8e483712d6a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:56.534397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93752d13-a633-49ff-a0cc-c8e483712d6a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:56.579160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e413f-d8e5-4dbd-ae74-af6e03af4e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:56.580177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e413f-d8e5-4dbd-ae74-af6e03af4e2a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:56.580653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e413f-d8e5-4dbd-ae74-af6e03af4e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:56.581228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e413f-d8e5-4dbd-ae74-af6e03af4e2a None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:56.582189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e413f-d8e5-4dbd-ae74-af6e03af4e2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:56.582706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e413f-d8e5-4dbd-ae74-af6e03af4e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:56.584289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e413f-d8e5-4dbd-ae74-af6e03af4e2a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:56.594119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 199/384] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:56.599489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd59f69-e7e7-49c9-84ab-9be412cb1a6e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:56.628660 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:56.707576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd59f69-e7e7-49c9-84ab-9be412cb1a6e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:56.748412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24e803-ba9c-4796-938d-fe365b8e960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:56.749662 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24e803-ba9c-4796-938d-fe365b8e960d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:56.750163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24e803-ba9c-4796-938d-fe365b8e960d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:56.750649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24e803-ba9c-4796-938d-fe365b8e960d None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:56.752116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24e803-ba9c-4796-938d-fe365b8e960d None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:56.753789 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24e803-ba9c-4796-938d-fe365b8e960d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:56.755971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 186/385] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:17:56 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:56.761716 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e413f-d8e5-4dbd-ae74-af6e03af4e2a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:56.791935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:56.871491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e413f-d8e5-4dbd-ae74-af6e03af4e2a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:56.910996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3048bee-13fd-46bc-a1ef-66bea0fd3288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:56.911869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048bee-13fd-46bc-a1ef-66bea0fd3288 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:56.912144 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048bee-13fd-46bc-a1ef-66bea0fd3288 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:56.912411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048bee-13fd-46bc-a1ef-66bea0fd3288 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:56.913715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3048bee-13fd-46bc-a1ef-66bea0fd3288 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:56.915154 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3048bee-13fd-46bc-a1ef-66bea0fd3288 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:56.917203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 200/386] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:56 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:56.922688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24e803-ba9c-4796-938d-fe365b8e960d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:57.063317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:57.070639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24e803-ba9c-4796-938d-fe365b8e960d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:57.106543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c296a-62ab-493d-990a-9f6aac6547cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:57.107446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c296a-62ab-493d-990a-9f6aac6547cd None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:57.107728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c296a-62ab-493d-990a-9f6aac6547cd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:57.108005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c296a-62ab-493d-990a-9f6aac6547cd None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513/groups/dfdcce67e5fa43d38aedd444f9812c8f/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:57.111494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c296a-62ab-493d-990a-9f6aac6547cd None admin] RBAC: Authorizing `identity:create_grant(project_id=c3623463132749bc9f5eb4efee71c513, group_id=dfdcce67e5fa43d38aedd444f9812c8f, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:57.113005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c296a-62ab-493d-990a-9f6aac6547cd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:57.133184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 187/387] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Jul 6 20:17:56 2022] PUT /identity/v3/projects/c3623463132749bc9f5eb4efee71c513/groups/dfdcce67e5fa43d38aedd444f9812c8f/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:17:57.427707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41903073-0fd3-4e68-9f31-250c9d49db49 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:57.428054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41903073-0fd3-4e68-9f31-250c9d49db49 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:57.428157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41903073-0fd3-4e68-9f31-250c9d49db49 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:57.430056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 201/388] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:57.435305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f76564-8409-440e-84b6-777f3fad120b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:57.436172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f76564-8409-440e-84b6-777f3fad120b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:57.436680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f76564-8409-440e-84b6-777f3fad120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:57.445042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec1b81-a925-4aab-9167-c813a36d899c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:57.445332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec1b81-a925-4aab-9167-c813a36d899c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:57.445608 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec1b81-a925-4aab-9167-c813a36d899c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:57.447269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 202/389] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:57.453791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4185a-5fe4-40c8-ba2d-d9624f4635b4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:57.454265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4185a-5fe4-40c8-ba2d-d9624f4635b4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:57.454685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4185a-5fe4-40c8-ba2d-d9624f4635b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:57.458157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-30f76564-8409-440e-84b6-777f3fad120b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:57.459333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-30f76564-8409-440e-84b6-777f3fad120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:57.485928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-56a4185a-5fe4-40c8-ba2d-d9624f4635b4 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:57.487103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-56a4185a-5fe4-40c8-ba2d-d9624f4635b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:57.583154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 188/390] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:17:57.592397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 203/391] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:57.614010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f76564-8409-440e-84b6-777f3fad120b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:57.624838 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4185a-5fe4-40c8-ba2d-d9624f4635b4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:57.662765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:57.717367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:57.731431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f76564-8409-440e-84b6-777f3fad120b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:57.776719 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4185a-5fe4-40c8-ba2d-d9624f4635b4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:57.781736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0f1d4-621d-4784-9cd9-3d2fd8143a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:57.782785 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0f1d4-621d-4784-9cd9-3d2fd8143a9a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:57.783067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0f1d4-621d-4784-9cd9-3d2fd8143a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:57.783335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0f1d4-621d-4784-9cd9-3d2fd8143a9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:57.798560 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0f1d4-621d-4784-9cd9-3d2fd8143a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a2e0f1d4-621d-4784-9cd9-3d2fd8143a9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:57.816059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:57.817066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:17:57.817863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:57.819408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 189/392] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:57.826038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0f1d4-621d-4784-9cd9-3d2fd8143a9a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:57.826285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940044d-cc9b-4eab-87bc-b47f8d2f0ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:57.827350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940044d-cc9b-4eab-87bc-b47f8d2f0ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:57.827835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940044d-cc9b-4eab-87bc-b47f8d2f0ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:57.828006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940044d-cc9b-4eab-87bc-b47f8d2f0ce6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:57.851223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940044d-cc9b-4eab-87bc-b47f8d2f0ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9940044d-cc9b-4eab-87bc-b47f8d2f0ce6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:57.859546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:57.860452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:57.861337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 204/393] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:17:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:17:57.873047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940044d-cc9b-4eab-87bc-b47f8d2f0ce6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:58.014552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0f1d4-621d-4784-9cd9-3d2fd8143a9a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:58.023630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:58.049314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940044d-cc9b-4eab-87bc-b47f8d2f0ce6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:58.052901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71a1f3-bf5b-4e9e-9838-1dde0a5cabe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:58.053769 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a1f3-bf5b-4e9e-9838-1dde0a5cabe7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.054199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a1f3-bf5b-4e9e-9838-1dde0a5cabe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.054567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a1f3-bf5b-4e9e-9838-1dde0a5cabe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.055419 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71a1f3-bf5b-4e9e-9838-1dde0a5cabe7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:58.055814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71a1f3-bf5b-4e9e-9838-1dde0a5cabe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:58.057500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71a1f3-bf5b-4e9e-9838-1dde0a5cabe7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:58.066765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 190/394] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:17:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:58.072172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71a1f3-bf5b-4e9e-9838-1dde0a5cabe7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:58.093807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:58.106624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccdc48-9d19-4eae-a3bb-f81a54f0b86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:58.107314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccdc48-9d19-4eae-a3bb-f81a54f0b86c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.107594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccdc48-9d19-4eae-a3bb-f81a54f0b86c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.108032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccdc48-9d19-4eae-a3bb-f81a54f0b86c None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.108940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccdc48-9d19-4eae-a3bb-f81a54f0b86c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:58.109433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccdc48-9d19-4eae-a3bb-f81a54f0b86c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:58.110948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccdc48-9d19-4eae-a3bb-f81a54f0b86c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:58.128753 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 205/395] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:17:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:58.129873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccdc48-9d19-4eae-a3bb-f81a54f0b86c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:58.180340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71a1f3-bf5b-4e9e-9838-1dde0a5cabe7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:58.217199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5b2ed-fe3d-4271-b047-13d7257c6306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:58.218376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b2ed-fe3d-4271-b047-13d7257c6306 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.218800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b2ed-fe3d-4271-b047-13d7257c6306 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.219253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b2ed-fe3d-4271-b047-13d7257c6306 None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.220675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5b2ed-fe3d-4271-b047-13d7257c6306 None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:58.222399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5b2ed-fe3d-4271-b047-13d7257c6306 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:58.224551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 191/396] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:17:58 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:58.230427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5b2ed-fe3d-4271-b047-13d7257c6306 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:58.276906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccdc48-9d19-4eae-a3bb-f81a54f0b86c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:58.310519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:58.327529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d00c1-152c-4540-adc0-1871a7188448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:58.328408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d00c1-152c-4540-adc0-1871a7188448 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.328688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d00c1-152c-4540-adc0-1871a7188448 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.328978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d00c1-152c-4540-adc0-1871a7188448 None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.333656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d00c1-152c-4540-adc0-1871a7188448 None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:58.335370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d00c1-152c-4540-adc0-1871a7188448 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:58.337576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 206/397] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:17:58 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:58.339384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5b2ed-fe3d-4271-b047-13d7257c6306 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:58.342675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d00c1-152c-4540-adc0-1871a7188448 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:58.364886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:58.377607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc52d8-98d1-4e4c-a683-f28837168a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:58.378754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc52d8-98d1-4e4c-a683-f28837168a52 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.379180 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc52d8-98d1-4e4c-a683-f28837168a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.379723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc52d8-98d1-4e4c-a683-f28837168a52 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.381234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc52d8-98d1-4e4c-a683-f28837168a52 None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:58.383341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc52d8-98d1-4e4c-a683-f28837168a52 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:58.385695 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 192/398] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:58 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:58.391495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc52d8-98d1-4e4c-a683-f28837168a52 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:58.460163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d00c1-152c-4540-adc0-1871a7188448 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:58.500080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36509f71-dff9-4efd-b2c8-a970a97d70f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:58.500994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509f71-dff9-4efd-b2c8-a970a97d70f1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.501252 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509f71-dff9-4efd-b2c8-a970a97d70f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.501528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509f71-dff9-4efd-b2c8-a970a97d70f1 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.502742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36509f71-dff9-4efd-b2c8-a970a97d70f1 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:58.504185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36509f71-dff9-4efd-b2c8-a970a97d70f1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:58.511010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 207/399] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:58 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:58.511848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36509f71-dff9-4efd-b2c8-a970a97d70f1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:58.513999 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc52d8-98d1-4e4c-a683-f28837168a52 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:58.571160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dd3af-b229-4a40-8e82-5e426bd02470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:58.571983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dd3af-b229-4a40-8e82-5e426bd02470 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.572260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dd3af-b229-4a40-8e82-5e426bd02470 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.572533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dd3af-b229-4a40-8e82-5e426bd02470 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495/groups/dfdcce67e5fa43d38aedd444f9812c8f/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.581899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dd3af-b229-4a40-8e82-5e426bd02470 None admin] RBAC: Authorizing `identity:create_grant(project_id=4677125e96014a6faa77a144d1e31495, group_id=dfdcce67e5fa43d38aedd444f9812c8f, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:58.583367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dd3af-b229-4a40-8e82-5e426bd02470 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:58.599718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:58.610872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 193/400] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Jul 6 20:17:58 2022] PUT /identity/v3/projects/4677125e96014a6faa77a144d1e31495/groups/dfdcce67e5fa43d38aedd444f9812c8f/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:17:58.612312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68548b6b-e617-4c53-bc45-f1db4a1b3932 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.612604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68548b6b-e617-4c53-bc45-f1db4a1b3932 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.612885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68548b6b-e617-4c53-bc45-f1db4a1b3932 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.614567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 194/401] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:58.622754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd23a-a993-4c56-bc8a-061836dd5ca4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.623049 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd23a-a993-4c56-bc8a-061836dd5ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.623298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd23a-a993-4c56-bc8a-061836dd5ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.632585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36509f71-dff9-4efd-b2c8-a970a97d70f1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:58.636344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:58.662122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7ecfd23a-a993-4c56-bc8a-061836dd5ca4 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:58.663405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7ecfd23a-a993-4c56-bc8a-061836dd5ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:58.673054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8451b10-3e12-4c72-a125-b03c11a15171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:58.674022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8451b10-3e12-4c72-a125-b03c11a15171 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.674306 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8451b10-3e12-4c72-a125-b03c11a15171 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.674582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8451b10-3e12-4c72-a125-b03c11a15171 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513/groups/dfdcce67e5fa43d38aedd444f9812c8f/roles/ce1cbac653a64c268855a459ce0aae34` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.676925 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8451b10-3e12-4c72-a125-b03c11a15171 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3623463132749bc9f5eb4efee71c513, group_id=dfdcce67e5fa43d38aedd444f9812c8f, role_id=ce1cbac653a64c268855a459ce0aae34)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:58.678523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8451b10-3e12-4c72-a125-b03c11a15171 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:58.700148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 208/402] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Jul 6 20:17:58 2022] PUT /identity/v3/projects/c3623463132749bc9f5eb4efee71c513/groups/dfdcce67e5fa43d38aedd444f9812c8f/roles/ce1cbac653a64c268855a459ce0aae34 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:17:58.793946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 195/403] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:58.830309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8451b10-3e12-4c72-a125-b03c11a15171 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:58.949012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8451b10-3e12-4c72-a125-b03c11a15171 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:58.983147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982cf5d-7f34-435c-9c22-3ed0c36fcc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:58.983975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cf5d-7f34-435c-9c22-3ed0c36fcc54 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.984261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cf5d-7f34-435c-9c22-3ed0c36fcc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.984539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cf5d-7f34-435c-9c22-3ed0c36fcc54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.994182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642d3ba-ef14-4b31-b39a-628befa084ef None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:58.994464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642d3ba-ef14-4b31-b39a-628befa084ef None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:58.994734 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642d3ba-ef14-4b31-b39a-628befa084ef None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:58.995442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982cf5d-7f34-435c-9c22-3ed0c36fcc54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:58.996243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 196/404] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:17:59.001492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7323738-029d-4735-9b25-ac368c6a0638 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:59.001977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7323738-029d-4735-9b25-ac368c6a0638 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:59.002438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7323738-029d-4735-9b25-ac368c6a0638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a982cf5d-7f34-435c-9c22-3ed0c36fcc54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:59.004200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:59.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:17:59.006195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 209/405] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:17:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:17:59.012007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982cf5d-7f34-435c-9c22-3ed0c36fcc54 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:59.021359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:59.026841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d7323738-029d-4735-9b25-ac368c6a0638 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:59.028332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d7323738-029d-4735-9b25-ac368c6a0638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:59.102856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 197/406] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:17:59.117162 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982cf5d-7f34-435c-9c22-3ed0c36fcc54 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:59.123318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7323738-029d-4735-9b25-ac368c6a0638 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:59.152658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1f7a9-8557-4e05-aa66-02a8babc986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:59.153297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1f7a9-8557-4e05-aa66-02a8babc986f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:59.153581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1f7a9-8557-4e05-aa66-02a8babc986f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:59.153859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1f7a9-8557-4e05-aa66-02a8babc986f None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:59.154620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1f7a9-8557-4e05-aa66-02a8babc986f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:59.154928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1f7a9-8557-4e05-aa66-02a8babc986f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:59.156463 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1f7a9-8557-4e05-aa66-02a8babc986f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:59.164976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 210/407] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:17:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:59.170451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1f7a9-8557-4e05-aa66-02a8babc986f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:59.188874 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:59.230191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7323738-029d-4735-9b25-ac368c6a0638 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:59.237353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:59.266954 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50763b5f-a43d-43f0-97b2-3302eb743b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:59.268063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50763b5f-a43d-43f0-97b2-3302eb743b95 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:59.268520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50763b5f-a43d-43f0-97b2-3302eb743b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:59.269070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50763b5f-a43d-43f0-97b2-3302eb743b95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:59.280275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50763b5f-a43d-43f0-97b2-3302eb743b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:17:59.282632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1f7a9-8557-4e05-aa66-02a8babc986f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-50763b5f-a43d-43f0-97b2-3302eb743b95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:17:59.288592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:17:59.289484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:17:59.290286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:17:59.297060 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 198/408] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:17:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:17:59.298964 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50763b5f-a43d-43f0-97b2-3302eb743b95 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:59.317401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dceb6f2-4bc4-4d5a-bddf-988646517886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:59.318269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceb6f2-4bc4-4d5a-bddf-988646517886 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:59.318550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceb6f2-4bc4-4d5a-bddf-988646517886 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:59.318824 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceb6f2-4bc4-4d5a-bddf-988646517886 None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:59.320076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dceb6f2-4bc4-4d5a-bddf-988646517886 None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:59.321546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dceb6f2-4bc4-4d5a-bddf-988646517886 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:59.323776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 211/409] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:17:59 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:59.328760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dceb6f2-4bc4-4d5a-bddf-988646517886 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:59.407699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50763b5f-a43d-43f0-97b2-3302eb743b95 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:59.451501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:59.471879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d575b3-b08f-4b50-84a1-2843ca3844c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:59.472927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d575b3-b08f-4b50-84a1-2843ca3844c2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:59.474092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d575b3-b08f-4b50-84a1-2843ca3844c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:59.474569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d575b3-b08f-4b50-84a1-2843ca3844c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:59.475741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d575b3-b08f-4b50-84a1-2843ca3844c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:17:59.477324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d575b3-b08f-4b50-84a1-2843ca3844c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:59.478995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d575b3-b08f-4b50-84a1-2843ca3844c2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:59.483819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dceb6f2-4bc4-4d5a-bddf-988646517886 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:59.498232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 199/410] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:17:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:59.508440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d575b3-b08f-4b50-84a1-2843ca3844c2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:59.544918 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:59.553269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3458d3-b080-4fef-9eae-3202925423ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:59.554253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3458d3-b080-4fef-9eae-3202925423ec None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:59.554531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3458d3-b080-4fef-9eae-3202925423ec None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:59.554799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3458d3-b080-4fef-9eae-3202925423ec None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:59.559189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3458d3-b080-4fef-9eae-3202925423ec None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:59.560638 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3458d3-b080-4fef-9eae-3202925423ec None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:59.562669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 212/411] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:59 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:17:59.568433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3458d3-b080-4fef-9eae-3202925423ec None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:59.695034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d575b3-b08f-4b50-84a1-2843ca3844c2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:59.733313 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3458d3-b080-4fef-9eae-3202925423ec None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:59.770548 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c3c6a-e2dc-4755-b7e3-0b7f5fad0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:59.771674 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c3c6a-e2dc-4755-b7e3-0b7f5fad0165 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:59.771949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c3c6a-e2dc-4755-b7e3-0b7f5fad0165 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:59.772221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c3c6a-e2dc-4755-b7e3-0b7f5fad0165 None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495/groups/dfdcce67e5fa43d38aedd444f9812c8f/roles/ce1cbac653a64c268855a459ce0aae34` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:59.774469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c3c6a-e2dc-4755-b7e3-0b7f5fad0165 None admin] RBAC: Authorizing `identity:create_grant(project_id=4677125e96014a6faa77a144d1e31495, group_id=dfdcce67e5fa43d38aedd444f9812c8f, role_id=ce1cbac653a64c268855a459ce0aae34)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:59.775928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c3c6a-e2dc-4755-b7e3-0b7f5fad0165 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:59.786438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24995e-0eb3-40f7-a7a0-5418dae55760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:17:59.787312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24995e-0eb3-40f7-a7a0-5418dae55760 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:59.787673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24995e-0eb3-40f7-a7a0-5418dae55760 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:59.787941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24995e-0eb3-40f7-a7a0-5418dae55760 None admin] PATH_INFO: `/v3/groups/49f0170fb261477dac87d0cbc04fd101` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:59.789227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24995e-0eb3-40f7-a7a0-5418dae55760 None admin] RBAC: Authorizing `identity:get_group(group_id=49f0170fb261477dac87d0cbc04fd101)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:17:59.790662 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24995e-0eb3-40f7-a7a0-5418dae55760 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:17:59.792590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 200/412] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:17:59 2022] GET /identity/v3/groups/49f0170fb261477dac87d0cbc04fd101 => generated 229 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:17:59.798414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b865a-f57a-4c57-94d2-e39d236ec687 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:59.798799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b865a-f57a-4c57-94d2-e39d236ec687 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:59.799182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b865a-f57a-4c57-94d2-e39d236ec687 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:59.799905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 213/413] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Jul 6 20:17:59 2022] PUT /identity/v3/projects/4677125e96014a6faa77a144d1e31495/groups/dfdcce67e5fa43d38aedd444f9812c8f/roles/ce1cbac653a64c268855a459ce0aae34 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:17:59.800636 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c3c6a-e2dc-4755-b7e3-0b7f5fad0165 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:17:59.801085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 201/414] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:17:59.808882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3c59-0b7c-49b6-8af6-92e38f512415 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:17:59.811631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3c59-0b7c-49b6-8af6-92e38f512415 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:17:59.812046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3c59-0b7c-49b6-8af6-92e38f512415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:17:59.856693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-535a3c59-0b7c-49b6-8af6-92e38f512415 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:17:59.861574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-535a3c59-0b7c-49b6-8af6-92e38f512415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:17:59.919276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:17:59.965127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c3c6a-e2dc-4755-b7e3-0b7f5fad0165 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:17:59.993409 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:00.013230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af7375-ab97-4d0e-b69a-40f37c94cdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:00.014529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af7375-ab97-4d0e-b69a-40f37c94cdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:00.014905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af7375-ab97-4d0e-b69a-40f37c94cdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:00.015366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af7375-ab97-4d0e-b69a-40f37c94cdf1 None admin] PATH_INFO: `/v3/projects/b9dceb457eba4f588d26a4848fffb9ba` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:00.016730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af7375-ab97-4d0e-b69a-40f37c94cdf1 None admin] RBAC: Authorizing `identity:get_project(project_id=b9dceb457eba4f588d26a4848fffb9ba)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:00.017798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 202/415] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:00.018397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af7375-ab97-4d0e-b69a-40f37c94cdf1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:00.020446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 214/416] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:17:59 2022] GET /identity/v3/projects/b9dceb457eba4f588d26a4848fffb9ba => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:00.026238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a3c59-0b7c-49b6-8af6-92e38f512415 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:00.045588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af7375-ab97-4d0e-b69a-40f37c94cdf1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:00.187767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a3c59-0b7c-49b6-8af6-92e38f512415 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:00.205978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af7375-ab97-4d0e-b69a-40f37c94cdf1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:00.235683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:00.248246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0ef21-fc14-41eb-b402-146984146031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:00.249556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ef21-fc14-41eb-b402-146984146031 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:00.250677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ef21-fc14-41eb-b402-146984146031 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:00.251250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ef21-fc14-41eb-b402-146984146031 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:00.267744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5100-581c-455f-8dc0-1fad168388b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:00.269667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5100-581c-455f-8dc0-1fad168388b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:00.273077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5100-581c-455f-8dc0-1fad168388b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:00.273585 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5100-581c-455f-8dc0-1fad168388b1 None admin] PATH_INFO: `/v3/projects/b9dceb457eba4f588d26a4848fffb9ba/groups/49f0170fb261477dac87d0cbc04fd101/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:00.276275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc5100-581c-455f-8dc0-1fad168388b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9dceb457eba4f588d26a4848fffb9ba, group_id=49f0170fb261477dac87d0cbc04fd101, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:00.277002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0ef21-fc14-41eb-b402-146984146031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:00.278553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc5100-581c-455f-8dc0-1fad168388b1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d7f0ef21-fc14-41eb-b402-146984146031 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:00.285963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:00.287412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:18:00.288456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:00.291458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 215/417] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:00.299144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 203/418] 10.222.0.30 () {58 vars in 1442 bytes} [Wed Jul 6 20:18:00 2022] PUT /identity/v3/projects/b9dceb457eba4f588d26a4848fffb9ba/groups/49f0170fb261477dac87d0cbc04fd101/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:18:00.300089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0ef21-fc14-41eb-b402-146984146031 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:00.453312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0ef21-fc14-41eb-b402-146984146031 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:00.501384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3099a6-6aa2-4fd7-9241-f6c52dbc2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:00.501983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3099a6-6aa2-4fd7-9241-f6c52dbc2023 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:00.502266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3099a6-6aa2-4fd7-9241-f6c52dbc2023 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:00.502545 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3099a6-6aa2-4fd7-9241-f6c52dbc2023 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:00.503305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3099a6-6aa2-4fd7-9241-f6c52dbc2023 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:00.503616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3099a6-6aa2-4fd7-9241-f6c52dbc2023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:00.505015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3099a6-6aa2-4fd7-9241-f6c52dbc2023 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:00.514332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 216/419] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:18:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:00.519944 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5100-581c-455f-8dc0-1fad168388b1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:00.604495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:00.690659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5100-581c-455f-8dc0-1fad168388b1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:00.733436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1a640-3c22-4d25-8db4-68e498e9648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:00.734187 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a640-3c22-4d25-8db4-68e498e9648a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:00.734366 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a640-3c22-4d25-8db4-68e498e9648a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:00.734640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a640-3c22-4d25-8db4-68e498e9648a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:00.836668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1a640-3c22-4d25-8db4-68e498e9648a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:00.838186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1a640-3c22-4d25-8db4-68e498e9648a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:00.900712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:00.953999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9e76-598c-44e6-9905-0f99e49a64ca None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:00.954560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9e76-598c-44e6-9905-0f99e49a64ca None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:00.954824 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9e76-598c-44e6-9905-0f99e49a64ca None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:00.956698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 217/420] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:00.962726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755f592-db25-4cf6-81d7-4ffd421e9371 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:00.963003 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755f592-db25-4cf6-81d7-4ffd421e9371 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:00.963513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755f592-db25-4cf6-81d7-4ffd421e9371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:00.975079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 204/421] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:00.980794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1a640-3c22-4d25-8db4-68e498e9648a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:00.983042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b755f592-db25-4cf6-81d7-4ffd421e9371 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:00.984225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b755f592-db25-4cf6-81d7-4ffd421e9371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:01.067207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:01.116768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 218/422] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:18:01.153018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1a640-3c22-4d25-8db4-68e498e9648a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:01.156734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755f592-db25-4cf6-81d7-4ffd421e9371 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:01.224122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799abf7a-bf9e-4079-8611-8ff42be1a303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:01.225628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799abf7a-bf9e-4079-8611-8ff42be1a303 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:01.227459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799abf7a-bf9e-4079-8611-8ff42be1a303 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:01.227735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799abf7a-bf9e-4079-8611-8ff42be1a303 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:01.229658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799abf7a-bf9e-4079-8611-8ff42be1a303 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:01.231112 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799abf7a-bf9e-4079-8611-8ff42be1a303 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:01.233324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 205/423] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:18:00 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:01.234658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a996a-e9dc-45f7-b504-d96471fd8caf None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:01.234939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a996a-e9dc-45f7-b504-d96471fd8caf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:01.235213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a996a-e9dc-45f7-b504-d96471fd8caf None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:01.236574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 206/424] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:01.246015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a996a-e9dc-45f7-b504-d96471fd8caf None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:01.256447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:01.295495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755f592-db25-4cf6-81d7-4ffd421e9371 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:01.333505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed884168-5341-400a-ba2a-7532984beeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:01.334724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed884168-5341-400a-ba2a-7532984beeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:01.335215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed884168-5341-400a-ba2a-7532984beeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:01.335693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed884168-5341-400a-ba2a-7532984beeb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:01.347039 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed884168-5341-400a-ba2a-7532984beeb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ed884168-5341-400a-ba2a-7532984beeb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:01.355693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:01.356595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:18:01.357430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:01.360277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 219/425] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:01.361733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a21d5-8346-4ccb-8a2d-370d9123b3c8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:01.362233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a21d5-8346-4ccb-8a2d-370d9123b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:01.362705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a21d5-8346-4ccb-8a2d-370d9123b3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:01.375156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a996a-e9dc-45f7-b504-d96471fd8caf None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:01.383210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b99a21d5-8346-4ccb-8a2d-370d9123b3c8 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:01.385229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b99a21d5-8346-4ccb-8a2d-370d9123b3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:01.417711 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d9df7-8158-44d8-aea1-450c72b86731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:01.418812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d9df7-8158-44d8-aea1-450c72b86731 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:01.419095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d9df7-8158-44d8-aea1-450c72b86731 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:01.419367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d9df7-8158-44d8-aea1-450c72b86731 None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:01.421261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d9df7-8158-44d8-aea1-450c72b86731 None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:01.423052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d9df7-8158-44d8-aea1-450c72b86731 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:01.425713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 207/426] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:18:01 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:01.426480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d9df7-8158-44d8-aea1-450c72b86731 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:01.428974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:01.477256 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 220/427] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:01.478440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a21d5-8346-4ccb-8a2d-370d9123b3c8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:01.535333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:01.558482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d9df7-8158-44d8-aea1-450c72b86731 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:01.593605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf316b-14e4-400d-93f4-ebde5ebd8283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:01.594634 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf316b-14e4-400d-93f4-ebde5ebd8283 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:01.595154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf316b-14e4-400d-93f4-ebde5ebd8283 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:01.595617 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf316b-14e4-400d-93f4-ebde5ebd8283 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:01.596498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a21d5-8346-4ccb-8a2d-370d9123b3c8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:01.596776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf316b-14e4-400d-93f4-ebde5ebd8283 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:01.597290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf316b-14e4-400d-93f4-ebde5ebd8283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:01.598866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf316b-14e4-400d-93f4-ebde5ebd8283 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:01.608004 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 208/428] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:18:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:01.609078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf316b-14e4-400d-93f4-ebde5ebd8283 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:01.638513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7af87f-6fcb-47b7-96e2-c107676490ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:01.639364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af87f-6fcb-47b7-96e2-c107676490ac None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:01.639651 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af87f-6fcb-47b7-96e2-c107676490ac None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:01.639929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af87f-6fcb-47b7-96e2-c107676490ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:01.640776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7af87f-6fcb-47b7-96e2-c107676490ac None admin] RBAC: Adding query filter params (group.id=dfdcce67e5fa43d38aedd444f9812c8f, role.id=0997a26e1c354ef5b0c2730f761b47ed, scope.project.id=c3623463132749bc9f5eb4efee71c513) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:01.641403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7af87f-6fcb-47b7-96e2-c107676490ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:01.643454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7af87f-6fcb-47b7-96e2-c107676490ac None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:01.650963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 221/429] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Jul 6 20:18:01 2022] GET /identity/v3/role_assignments?group.id=dfdcce67e5fa43d38aedd444f9812c8f&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:01.652202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7af87f-6fcb-47b7-96e2-c107676490ac None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:01.703127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:01.724548 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf316b-14e4-400d-93f4-ebde5ebd8283 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:01.798002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6fde0-9126-4eb0-ae86-fe19efe9aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:01.799748 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6fde0-9126-4eb0-ae86-fe19efe9aa06 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:01.801851 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6fde0-9126-4eb0-ae86-fe19efe9aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:01.802395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6fde0-9126-4eb0-ae86-fe19efe9aa06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:01.827232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:01.834732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6fde0-9126-4eb0-ae86-fe19efe9aa06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b4c6fde0-9126-4eb0-ae86-fe19efe9aa06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:01.846077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:01.847029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:18:01.847828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:01.848431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 209/430] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:01.856598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6fde0-9126-4eb0-ae86-fe19efe9aa06 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:01.860318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7af87f-6fcb-47b7-96e2-c107676490ac None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:01.908247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344739a-267d-4d94-852d-e99fffc02e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:01.909384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344739a-267d-4d94-852d-e99fffc02e11 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:01.909674 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344739a-267d-4d94-852d-e99fffc02e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:01.909947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344739a-267d-4d94-852d-e99fffc02e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.000159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6fde0-9126-4eb0-ae86-fe19efe9aa06 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:02.000383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344739a-267d-4d94-852d-e99fffc02e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:02.001739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344739a-267d-4d94-852d-e99fffc02e11 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:02.041818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72c13e-df8d-472f-996a-35971d6dc7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:02.042842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72c13e-df8d-472f-996a-35971d6dc7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.043316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72c13e-df8d-472f-996a-35971d6dc7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.044194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72c13e-df8d-472f-996a-35971d6dc7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.045181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72c13e-df8d-472f-996a-35971d6dc7a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:02.045701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72c13e-df8d-472f-996a-35971d6dc7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:02.045870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:02.047408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72c13e-df8d-472f-996a-35971d6dc7a1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:02.056742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 210/431] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:02.062392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72c13e-df8d-472f-996a-35971d6dc7a1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:02.125669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 222/432] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:02.126708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:02.131187 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344739a-267d-4d94-852d-e99fffc02e11 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:02.168377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72c13e-df8d-472f-996a-35971d6dc7a1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:02.204133 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8189c-447e-468e-bced-b2fb3e729cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:02.204998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8189c-447e-468e-bced-b2fb3e729cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.205121 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8189c-447e-468e-bced-b2fb3e729cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.205348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8189c-447e-468e-bced-b2fb3e729cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.249862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344739a-267d-4d94-852d-e99fffc02e11 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:02.285624 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8189c-447e-468e-bced-b2fb3e729cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:02.287096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8189c-447e-468e-bced-b2fb3e729cd4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:02.296814 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0538b14-592b-4b4b-904c-abba7097133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:02.298092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0538b14-592b-4b4b-904c-abba7097133e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.298388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0538b14-592b-4b4b-904c-abba7097133e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.298666 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0538b14-592b-4b4b-904c-abba7097133e None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.300758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0538b14-592b-4b4b-904c-abba7097133e None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:02.302262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0538b14-592b-4b4b-904c-abba7097133e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:02.304387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 223/433] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:18:02 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:02.308979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a21de-38c7-420c-aac2-9dfa39d2e233 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.308979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a21de-38c7-420c-aac2-9dfa39d2e233 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.308979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a21de-38c7-420c-aac2-9dfa39d2e233 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.308979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 224/434] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:02.311992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a21de-38c7-420c-aac2-9dfa39d2e233 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:02.315080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:02.371100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:02.417653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 211/435] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:18:02.418927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f6f9b-b577-419a-a668-a3d1daec764a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.419160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f6f9b-b577-419a-a668-a3d1daec764a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.419438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f6f9b-b577-419a-a668-a3d1daec764a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.434187 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a21de-38c7-420c-aac2-9dfa39d2e233 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:02.440604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-035f6f9b-b577-419a-a668-a3d1daec764a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:02.441820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-035f6f9b-b577-419a-a668-a3d1daec764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:02.471782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215d648-6fed-48a1-aae9-c28195acec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:02.472649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215d648-6fed-48a1-aae9-c28195acec10 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.472930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215d648-6fed-48a1-aae9-c28195acec10 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.473464 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215d648-6fed-48a1-aae9-c28195acec10 None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.474443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215d648-6fed-48a1-aae9-c28195acec10 None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:02.475923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215d648-6fed-48a1-aae9-c28195acec10 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:02.477799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 225/436] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:18:02 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:02.478484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215d648-6fed-48a1-aae9-c28195acec10 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:02.514065 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 212/437] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:02.514910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f6f9b-b577-419a-a668-a3d1daec764a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:02.558991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:02.592361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215d648-6fed-48a1-aae9-c28195acec10 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:02.614271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:02.624311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f6f9b-b577-419a-a668-a3d1daec764a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:02.628012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa7a37-e3ea-407b-bed2-a54c1e1566f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:02.628891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa7a37-e3ea-407b-bed2-a54c1e1566f1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.629220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa7a37-e3ea-407b-bed2-a54c1e1566f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.629497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa7a37-e3ea-407b-bed2-a54c1e1566f1 None admin] PATH_INFO: `/v3/projects/c3623463132749bc9f5eb4efee71c513` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.630693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa7a37-e3ea-407b-bed2-a54c1e1566f1 None admin] RBAC: Authorizing `identity:get_project(project_id=c3623463132749bc9f5eb4efee71c513)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:02.632498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa7a37-e3ea-407b-bed2-a54c1e1566f1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:02.634229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 226/438] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:18:02 2022] GET /identity/v3/projects/c3623463132749bc9f5eb4efee71c513 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:02.634983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa7a37-e3ea-407b-bed2-a54c1e1566f1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:02.665379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841055a0-a119-4df7-b145-3db9e9265cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:02.666110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841055a0-a119-4df7-b145-3db9e9265cef None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.666394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841055a0-a119-4df7-b145-3db9e9265cef None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.666667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841055a0-a119-4df7-b145-3db9e9265cef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.667511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841055a0-a119-4df7-b145-3db9e9265cef None admin] RBAC: Adding query filter params (group.id=dfdcce67e5fa43d38aedd444f9812c8f, role.id=0997a26e1c354ef5b0c2730f761b47ed, scope.project.id=4677125e96014a6faa77a144d1e31495) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:02.667830 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841055a0-a119-4df7-b145-3db9e9265cef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:02.669328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841055a0-a119-4df7-b145-3db9e9265cef None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:02.684984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 213/439] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Jul 6 20:18:02 2022] GET /identity/v3/role_assignments?group.id=dfdcce67e5fa43d38aedd444f9812c8f&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=0997a26e1c354ef5b0c2730f761b47ed => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:02.684984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841055a0-a119-4df7-b145-3db9e9265cef None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:02.761862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa7a37-e3ea-407b-bed2-a54c1e1566f1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:02.804292 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841055a0-a119-4df7-b145-3db9e9265cef None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:02.806126 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b0e8c-1d87-4a73-a52c-4070c0fcf0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:02.807546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0e8c-1d87-4a73-a52c-4070c0fcf0ed None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.807546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0e8c-1d87-4a73-a52c-4070c0fcf0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.807546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0e8c-1d87-4a73-a52c-4070c0fcf0ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.815736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:02.820203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b0e8c-1d87-4a73-a52c-4070c0fcf0ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3c2b0e8c-1d87-4a73-a52c-4070c0fcf0ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:02.830016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:02.830936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:02.832063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 227/440] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:02.833027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc17d1-157e-4c34-90a1-13b01fb2e7ea None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.833296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc17d1-157e-4c34-90a1-13b01fb2e7ea None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.833934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc17d1-157e-4c34-90a1-13b01fb2e7ea None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.835437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 228/441] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:02.837975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc17d1-157e-4c34-90a1-13b01fb2e7ea None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:02.855324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac02380-0ad0-44ec-90dd-2513ea5eb42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:02.859245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac02380-0ad0-44ec-90dd-2513ea5eb42a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.859245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac02380-0ad0-44ec-90dd-2513ea5eb42a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.859245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac02380-0ad0-44ec-90dd-2513ea5eb42a None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.859245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac02380-0ad0-44ec-90dd-2513ea5eb42a None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:02.860808 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac02380-0ad0-44ec-90dd-2513ea5eb42a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:02.862994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 214/442] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:18:02 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:02.864454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e09806-f08b-4d0f-8cb4-715c4a222a81 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.864736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e09806-f08b-4d0f-8cb4-715c4a222a81 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.865031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e09806-f08b-4d0f-8cb4-715c4a222a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.886846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a7e09806-f08b-4d0f-8cb4-715c4a222a81 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:02.888333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a7e09806-f08b-4d0f-8cb4-715c4a222a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:02.907937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:02.947438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc17d1-157e-4c34-90a1-13b01fb2e7ea None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:02.956566 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 215/443] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:02.957443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e09806-f08b-4d0f-8cb4-715c4a222a81 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:02.981198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04054e-195e-4945-a56a-efea9e95f2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:02.981873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04054e-195e-4945-a56a-efea9e95f2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:02.982156 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04054e-195e-4945-a56a-efea9e95f2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:02.982431 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04054e-195e-4945-a56a-efea9e95f2c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:02.983194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04054e-195e-4945-a56a-efea9e95f2c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:02.983505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04054e-195e-4945-a56a-efea9e95f2c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:02.984883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04054e-195e-4945-a56a-efea9e95f2c2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:02.992826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 229/444] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:02.993682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04054e-195e-4945-a56a-efea9e95f2c2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:03.050228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:03.058979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e09806-f08b-4d0f-8cb4-715c4a222a81 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:03.090177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04054e-195e-4945-a56a-efea9e95f2c2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:03.091943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a604a81-8dfa-4bd3-bd17-c997a1cc4990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:03.092591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a604a81-8dfa-4bd3-bd17-c997a1cc4990 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:03.092865 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a604a81-8dfa-4bd3-bd17-c997a1cc4990 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:03.093170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a604a81-8dfa-4bd3-bd17-c997a1cc4990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:03.094006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a604a81-8dfa-4bd3-bd17-c997a1cc4990 None admin] RBAC: Adding query filter params (group.id=dfdcce67e5fa43d38aedd444f9812c8f, role.id=ce1cbac653a64c268855a459ce0aae34, scope.project.id=c3623463132749bc9f5eb4efee71c513) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:03.094313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a604a81-8dfa-4bd3-bd17-c997a1cc4990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:03.095761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a604a81-8dfa-4bd3-bd17-c997a1cc4990 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:03.101570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 216/445] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Jul 6 20:18:02 2022] GET /identity/v3/role_assignments?group.id=dfdcce67e5fa43d38aedd444f9812c8f&scope.project.id=c3623463132749bc9f5eb4efee71c513&role.id=ce1cbac653a64c268855a459ce0aae34 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:03.102340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a604a81-8dfa-4bd3-bd17-c997a1cc4990 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:03.122986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:03.127824 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280f983-4ebc-4f14-a0ca-4a4f073f2852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:03.128692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280f983-4ebc-4f14-a0ca-4a4f073f2852 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:03.128996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280f983-4ebc-4f14-a0ca-4a4f073f2852 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:03.129280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280f983-4ebc-4f14-a0ca-4a4f073f2852 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:03.141867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280f983-4ebc-4f14-a0ca-4a4f073f2852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6280f983-4ebc-4f14-a0ca-4a4f073f2852 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:03.149986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:03.151135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:03.152133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 230/446] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:03.157080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280f983-4ebc-4f14-a0ca-4a4f073f2852 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:03.218274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a604a81-8dfa-4bd3-bd17-c997a1cc4990 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:03.254446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41e32e-61a7-451b-ab1d-077cb2c4cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:03.255098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41e32e-61a7-451b-ab1d-077cb2c4cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:03.255373 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41e32e-61a7-451b-ab1d-077cb2c4cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:03.255643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41e32e-61a7-451b-ab1d-077cb2c4cfe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:03.275142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280f983-4ebc-4f14-a0ca-4a4f073f2852 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:03.298326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:03.315174 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bb9ff-08bd-468c-b89d-85f75ef70a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:03.315846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bb9ff-08bd-468c-b89d-85f75ef70a26 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:03.316129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bb9ff-08bd-468c-b89d-85f75ef70a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:03.316407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bb9ff-08bd-468c-b89d-85f75ef70a26 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:03.317203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bb9ff-08bd-468c-b89d-85f75ef70a26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:03.317536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bb9ff-08bd-468c-b89d-85f75ef70a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:03.318922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bb9ff-08bd-468c-b89d-85f75ef70a26 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:03.327589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 231/447] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:03.333143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bb9ff-08bd-468c-b89d-85f75ef70a26 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:03.347311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41e32e-61a7-451b-ab1d-077cb2c4cfe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:03.348872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41e32e-61a7-451b-ab1d-077cb2c4cfe9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:03.367916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:03.448784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bb9ff-08bd-468c-b89d-85f75ef70a26 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:03.465059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 217/448] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:03.470511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41e32e-61a7-451b-ab1d-077cb2c4cfe9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:03.492363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268617b-dbb3-491a-9f1a-f8911e83c217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:03.492568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268617b-dbb3-491a-9f1a-f8911e83c217 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:03.492730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268617b-dbb3-491a-9f1a-f8911e83c217 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:03.493025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268617b-dbb3-491a-9f1a-f8911e83c217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:03.555673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:03.576945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268617b-dbb3-491a-9f1a-f8911e83c217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:03.578458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268617b-dbb3-491a-9f1a-f8911e83c217 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:03.589476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41e32e-61a7-451b-ab1d-077cb2c4cfe9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:03.607879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:03.625119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd421155-cc3b-4335-83b7-4cd94d49e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:03.625983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd421155-cc3b-4335-83b7-4cd94d49e30d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:03.626312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd421155-cc3b-4335-83b7-4cd94d49e30d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:03.626578 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd421155-cc3b-4335-83b7-4cd94d49e30d None admin] PATH_INFO: `/v3/projects/4677125e96014a6faa77a144d1e31495` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:03.627753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd421155-cc3b-4335-83b7-4cd94d49e30d None admin] RBAC: Authorizing `identity:get_project(project_id=4677125e96014a6faa77a144d1e31495)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:03.629210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd421155-cc3b-4335-83b7-4cd94d49e30d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:03.630893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 218/449] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:18:03 2022] GET /identity/v3/projects/4677125e96014a6faa77a144d1e31495 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:03.636584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd421155-cc3b-4335-83b7-4cd94d49e30d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:03.682028 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 232/450] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:18:03.687511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268617b-dbb3-491a-9f1a-f8911e83c217 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:03.735102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd421155-cc3b-4335-83b7-4cd94d49e30d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:03.767565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:03.769181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168953e-9ec1-48b3-abdb-ec0515558187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:03.770185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168953e-9ec1-48b3-abdb-ec0515558187 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:03.770471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168953e-9ec1-48b3-abdb-ec0515558187 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:03.770766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168953e-9ec1-48b3-abdb-ec0515558187 None admin] PATH_INFO: `/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:03.771949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168953e-9ec1-48b3-abdb-ec0515558187 None admin] RBAC: Authorizing `identity:get_group(group_id=dfdcce67e5fa43d38aedd444f9812c8f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:03.774042 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168953e-9ec1-48b3-abdb-ec0515558187 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:03.776413 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 219/451] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:18:03 2022] GET /identity/v3/groups/dfdcce67e5fa43d38aedd444f9812c8f => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:03.783229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168953e-9ec1-48b3-abdb-ec0515558187 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:03.788016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268617b-dbb3-491a-9f1a-f8911e83c217 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:03.828139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a2b8-9d85-48eb-b6b8-098e6228a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:03.829042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a2b8-9d85-48eb-b6b8-098e6228a029 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:03.829322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a2b8-9d85-48eb-b6b8-098e6228a029 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:03.829592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a2b8-9d85-48eb-b6b8-098e6228a029 None admin] PATH_INFO: `/v3/projects/b9dceb457eba4f588d26a4848fffb9ba` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:03.830793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7a2b8-9d85-48eb-b6b8-098e6228a029 None admin] RBAC: Authorizing `identity:get_project(project_id=b9dceb457eba4f588d26a4848fffb9ba)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:03.832225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7a2b8-9d85-48eb-b6b8-098e6228a029 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:03.833967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 233/452] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:18:03 2022] GET /identity/v3/projects/b9dceb457eba4f588d26a4848fffb9ba => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:03.839334 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a2b8-9d85-48eb-b6b8-098e6228a029 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:03.841927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:03.888736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168953e-9ec1-48b3-abdb-ec0515558187 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:03.920649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c8e15-10b4-45e9-9c6a-b4c9bb491682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:03.921310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c8e15-10b4-45e9-9c6a-b4c9bb491682 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:03.921619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c8e15-10b4-45e9-9c6a-b4c9bb491682 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:03.921890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c8e15-10b4-45e9-9c6a-b4c9bb491682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:03.922728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c8e15-10b4-45e9-9c6a-b4c9bb491682 None admin] RBAC: Adding query filter params (group.id=dfdcce67e5fa43d38aedd444f9812c8f, role.id=ce1cbac653a64c268855a459ce0aae34, scope.project.id=4677125e96014a6faa77a144d1e31495) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:03.923038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c8e15-10b4-45e9-9c6a-b4c9bb491682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:03.924478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c8e15-10b4-45e9-9c6a-b4c9bb491682 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:03.930389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 220/453] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Jul 6 20:18:03 2022] GET /identity/v3/role_assignments?group.id=dfdcce67e5fa43d38aedd444f9812c8f&scope.project.id=4677125e96014a6faa77a144d1e31495&role.id=ce1cbac653a64c268855a459ce0aae34 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:03.939107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a2b8-9d85-48eb-b6b8-098e6228a029 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:03.976202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e2393-297e-4981-84f4-088d20b66c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:03.977110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e2393-297e-4981-84f4-088d20b66c8a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:03.977396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e2393-297e-4981-84f4-088d20b66c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:03.977670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e2393-297e-4981-84f4-088d20b66c8a None admin] PATH_INFO: `/v3/groups/49f0170fb261477dac87d0cbc04fd101` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:03.979013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e2393-297e-4981-84f4-088d20b66c8a None admin] RBAC: Authorizing `identity:get_group(group_id=49f0170fb261477dac87d0cbc04fd101)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:03.980503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e2393-297e-4981-84f4-088d20b66c8a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:03.982595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 234/454] 10.222.0.30 () {56 vars in 1180 bytes} [Wed Jul 6 20:18:03 2022] GET /identity/v3/groups/49f0170fb261477dac87d0cbc04fd101 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:03.988763 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c8e15-10b4-45e9-9c6a-b4c9bb491682 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:04.094302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c8e15-10b4-45e9-9c6a-b4c9bb491682 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:04.113975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:04.134249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e80eb7-da06-4510-afec-ad6ec74e0986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:04.134990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e80eb7-da06-4510-afec-ad6ec74e0986 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:04.135301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e80eb7-da06-4510-afec-ad6ec74e0986 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:04.135569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e80eb7-da06-4510-afec-ad6ec74e0986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:04.136412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e80eb7-da06-4510-afec-ad6ec74e0986 None admin] RBAC: Adding query filter params (group.id=49f0170fb261477dac87d0cbc04fd101, role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=b9dceb457eba4f588d26a4848fffb9ba) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:04.136722 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e80eb7-da06-4510-afec-ad6ec74e0986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:04.138209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e80eb7-da06-4510-afec-ad6ec74e0986 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:04.144518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 221/455] 10.222.0.30 () {56 vars in 1376 bytes} [Wed Jul 6 20:18:03 2022] GET /identity/v3/role_assignments?group.id=49f0170fb261477dac87d0cbc04fd101&scope.project.id=b9dceb457eba4f588d26a4848fffb9ba&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:06.677711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30302a71-9a4c-47a2-bc67-66f8e3a6d7da None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:06.678636 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30302a71-9a4c-47a2-bc67-66f8e3a6d7da None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:06.679056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30302a71-9a4c-47a2-bc67-66f8e3a6d7da None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:06.680811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 235/456] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:06.686462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96b9b-7ac6-4d4b-870f-bc71b016ec0e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:06.686870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96b9b-7ac6-4d4b-870f-bc71b016ec0e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:06.687195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96b9b-7ac6-4d4b-870f-bc71b016ec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:06.712838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c0b96b9b-7ac6-4d4b-870f-bc71b016ec0e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:06.714164 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c0b96b9b-7ac6-4d4b-870f-bc71b016ec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:06.804537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 222/457] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:06.815422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3842d85-5a2f-42f2-b94c-dce80f88fd48 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:06.815986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3842d85-5a2f-42f2-b94c-dce80f88fd48 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:06.816459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3842d85-5a2f-42f2-b94c-dce80f88fd48 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:06.818370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 236/458] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:06.823998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea665-7ed6-4b53-917e-12d95ed4e24e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:06.823998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea665-7ed6-4b53-917e-12d95ed4e24e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:06.823998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea665-7ed6-4b53-917e-12d95ed4e24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:06.842215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3842d85-5a2f-42f2-b94c-dce80f88fd48 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:06.853976 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-960ea665-7ed6-4b53-917e-12d95ed4e24e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:06.855176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-960ea665-7ed6-4b53-917e-12d95ed4e24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:06.865173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:06.945168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 223/459] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:06.946757 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeba3b-0540-47d3-abb8-1e07d066b922 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:06.947049 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeba3b-0540-47d3-abb8-1e07d066b922 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:06.947326 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeba3b-0540-47d3-abb8-1e07d066b922 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:06.949009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 224/460] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:06.963172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e2cb0-3fd1-4151-bdfc-31ed0dff845c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:06.963489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e2cb0-3fd1-4151-bdfc-31ed0dff845c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:06.963691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3842d85-5a2f-42f2-b94c-dce80f88fd48 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:06.963794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e2cb0-3fd1-4151-bdfc-31ed0dff845c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:06.988809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-391e2cb0-3fd1-4151-bdfc-31ed0dff845c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:06.990841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-391e2cb0-3fd1-4151-bdfc-31ed0dff845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:07.000832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a267f-4f42-4438-a95d-a5fae6aeb93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:07.001661 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a267f-4f42-4438-a95d-a5fae6aeb93e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.001936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a267f-4f42-4438-a95d-a5fae6aeb93e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.002298 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a267f-4f42-4438-a95d-a5fae6aeb93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:07.013576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a267f-4f42-4438-a95d-a5fae6aeb93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:07.015035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a267f-4f42-4438-a95d-a5fae6aeb93e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:07.032080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c33a267f-4f42-4438-a95d-a5fae6aeb93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:07.035486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:07.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:07.037648 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:07.037648 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:07.037648 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:07.037648 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:07.039559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 237/461] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:07.040543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a267f-4f42-4438-a95d-a5fae6aeb93e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:07.077057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 225/462] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:07.077958 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e2cb0-3fd1-4151-bdfc-31ed0dff845c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:07.115159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:07.149663 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a267f-4f42-4438-a95d-a5fae6aeb93e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:07.185763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa66db-a8f1-4aee-af0b-616fdfd84e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:07.186927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa66db-a8f1-4aee-af0b-616fdfd84e1e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.187395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa66db-a8f1-4aee-af0b-616fdfd84e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.187871 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa66db-a8f1-4aee-af0b-616fdfd84e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:07.198697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa66db-a8f1-4aee-af0b-616fdfd84e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:07.200376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa66db-a8f1-4aee-af0b-616fdfd84e1e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:07.201678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e2cb0-3fd1-4151-bdfc-31ed0dff845c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0eaa66db-a8f1-4aee-af0b-616fdfd84e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:07.218854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:07.219759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:07.220587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:07.220587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:07.220587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:07.220587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:07.222794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 238/463] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:07.223763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa66db-a8f1-4aee-af0b-616fdfd84e1e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:07.241582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516040-a19c-4e34-ae01-8b25dd2b28c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:07.242212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516040-a19c-4e34-ae01-8b25dd2b28c3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.242493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516040-a19c-4e34-ae01-8b25dd2b28c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.242769 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516040-a19c-4e34-ae01-8b25dd2b28c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:07.243501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94516040-a19c-4e34-ae01-8b25dd2b28c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:07.243805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94516040-a19c-4e34-ae01-8b25dd2b28c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:07.245211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94516040-a19c-4e34-ae01-8b25dd2b28c3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:07.257729 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 226/464] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:07.258596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516040-a19c-4e34-ae01-8b25dd2b28c3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:07.292356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:07.330308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa66db-a8f1-4aee-af0b-616fdfd84e1e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:07.354182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:07.363945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516040-a19c-4e34-ae01-8b25dd2b28c3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:07.366850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf1401-b8a1-47b5-aad7-a38300904d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:07.367525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf1401-b8a1-47b5-aad7-a38300904d81 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.367801 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf1401-b8a1-47b5-aad7-a38300904d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.368070 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf1401-b8a1-47b5-aad7-a38300904d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:07.378327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf1401-b8a1-47b5-aad7-a38300904d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:07.379760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf1401-b8a1-47b5-aad7-a38300904d81 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:07.398330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19982a31-07c3-405d-9abc-81aee9481d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e3bf1401-b8a1-47b5-aad7-a38300904d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:07.398577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:07.399391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:07.405284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:07.405284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:07.405284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:07.405284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:07.405583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19982a31-07c3-405d-9abc-81aee9481d7e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.405583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19982a31-07c3-405d-9abc-81aee9481d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.405583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19982a31-07c3-405d-9abc-81aee9481d7e None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:07.405796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 239/465] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:07.405876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19982a31-07c3-405d-9abc-81aee9481d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:07.405876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19982a31-07c3-405d-9abc-81aee9481d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:07.406108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf1401-b8a1-47b5-aad7-a38300904d81 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:07.406188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19982a31-07c3-405d-9abc-81aee9481d7e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:07.417100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 227/466] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:07.418445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74aa0e-e4f8-4c28-b870-51f3782fb724 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.419050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74aa0e-e4f8-4c28-b870-51f3782fb724 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.419050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74aa0e-e4f8-4c28-b870-51f3782fb724 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:07.424392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 228/467] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:07.425287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74aa0e-e4f8-4c28-b870-51f3782fb724 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:07.513477 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf1401-b8a1-47b5-aad7-a38300904d81 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:07.525152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:07.536124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74aa0e-e4f8-4c28-b870-51f3782fb724 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:07.548846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999351d-4f99-4e7a-bf4a-f4c40ab857ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:07.549552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999351d-4f99-4e7a-bf4a-f4c40ab857ea None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.549836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999351d-4f99-4e7a-bf4a-f4c40ab857ea None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.550109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999351d-4f99-4e7a-bf4a-f4c40ab857ea None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:07.550814 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999351d-4f99-4e7a-bf4a-f4c40ab857ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:07.552249 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999351d-4f99-4e7a-bf4a-f4c40ab857ea None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:07.580998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 240/468] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:18:07 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:07.580998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999351d-4f99-4e7a-bf4a-f4c40ab857ea None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:07.582548 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312828a8-c7ee-4aeb-afd5-15662bb7d30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:07.583335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312828a8-c7ee-4aeb-afd5-15662bb7d30b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.583682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312828a8-c7ee-4aeb-afd5-15662bb7d30b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.584025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312828a8-c7ee-4aeb-afd5-15662bb7d30b None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:07.584890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312828a8-c7ee-4aeb-afd5-15662bb7d30b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:07.585307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312828a8-c7ee-4aeb-afd5-15662bb7d30b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:07.586817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312828a8-c7ee-4aeb-afd5-15662bb7d30b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:07.600715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 229/469] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:07.606625 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db3104-5994-40a1-9dc2-9a169f14ec6f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.606927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db3104-5994-40a1-9dc2-9a169f14ec6f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.607234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db3104-5994-40a1-9dc2-9a169f14ec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:07.625059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-30db3104-5994-40a1-9dc2-9a169f14ec6f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:07.626268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-30db3104-5994-40a1-9dc2-9a169f14ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:07.635662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:07.702853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999351d-4f99-4e7a-bf4a-f4c40ab857ea None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:07.710029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 230/470] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:07.711021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db3104-5994-40a1-9dc2-9a169f14ec6f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:07.765587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0e47e-5cee-4a7d-a48d-b8c10b2f720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:07.766291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0e47e-5cee-4a7d-a48d-b8c10b2f720e None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.766656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0e47e-5cee-4a7d-a48d-b8c10b2f720e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.766936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0e47e-5cee-4a7d-a48d-b8c10b2f720e None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:07.767699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0e47e-5cee-4a7d-a48d-b8c10b2f720e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:07.769288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0e47e-5cee-4a7d-a48d-b8c10b2f720e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:07.791803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 241/471] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:18:07 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:07.792695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0e47e-5cee-4a7d-a48d-b8c10b2f720e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:07.815329 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:07.846291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db3104-5994-40a1-9dc2-9a169f14ec6f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:07.889150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c453122-66cc-4df3-8464-2d24a7142360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:07.889891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c453122-66cc-4df3-8464-2d24a7142360 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.890175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c453122-66cc-4df3-8464-2d24a7142360 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.890451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c453122-66cc-4df3-8464-2d24a7142360 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:07.891179 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c453122-66cc-4df3-8464-2d24a7142360 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:07.892648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c453122-66cc-4df3-8464-2d24a7142360 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:07.909371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:07.931686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 231/472] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:18:07 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:07.940085 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0e47e-5cee-4a7d-a48d-b8c10b2f720e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:07.987024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bf2a1-75ad-4deb-b7a0-1a850183fac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:07.987843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf2a1-75ad-4deb-b7a0-1a850183fac8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:07.988125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf2a1-75ad-4deb-b7a0-1a850183fac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:07.988399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf2a1-75ad-4deb-b7a0-1a850183fac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:08.002117 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bf2a1-75ad-4deb-b7a0-1a850183fac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:08.003722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bf2a1-75ad-4deb-b7a0-1a850183fac8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-677bf2a1-75ad-4deb-b7a0-1a850183fac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:08.023625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:08.024557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:08.025502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:08.025502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:08.025502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:08.025502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:08.025502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 242/473] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:08.030909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c453122-66cc-4df3-8464-2d24a7142360 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:08.119462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb6567-8e26-4609-a203-9f291e62ca57 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:08.120556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb6567-8e26-4609-a203-9f291e62ca57 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:08.120786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb6567-8e26-4609-a203-9f291e62ca57 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:08.126881 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 243/474] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:08.131220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2bed4-dbcb-4e87-aec2-73eafd2de841 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:08.131811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2bed4-dbcb-4e87-aec2-73eafd2de841 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:08.132613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2bed4-dbcb-4e87-aec2-73eafd2de841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:08.157376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-62d2bed4-dbcb-4e87-aec2-73eafd2de841 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:08.158477 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-62d2bed4-dbcb-4e87-aec2-73eafd2de841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:08.172620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c453122-66cc-4df3-8464-2d24a7142360 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:08.217170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97a079-2901-4a81-81eb-4ca6d722b0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:08.218331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97a079-2901-4a81-81eb-4ca6d722b0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:08.218812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97a079-2901-4a81-81eb-4ca6d722b0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:08.219377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97a079-2901-4a81-81eb-4ca6d722b0a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:08.220330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97a079-2901-4a81-81eb-4ca6d722b0a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:08.220830 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97a079-2901-4a81-81eb-4ca6d722b0a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:08.222639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97a079-2901-4a81-81eb-4ca6d722b0a0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:08.230810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:08.238719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 232/475] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:08.242780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 244/476] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:08.250051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97a079-2901-4a81-81eb-4ca6d722b0a0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:08.271959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2bed4-dbcb-4e87-aec2-73eafd2de841 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:08.371978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:08.378433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97a079-2901-4a81-81eb-4ca6d722b0a0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:08.415559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2bed4-dbcb-4e87-aec2-73eafd2de841 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:08.416857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4670a0-cd3b-4194-9808-9189e8698c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:08.418014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4670a0-cd3b-4194-9808-9189e8698c5c None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:08.418530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4670a0-cd3b-4194-9808-9189e8698c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:08.419030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4670a0-cd3b-4194-9808-9189e8698c5c None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:08.419994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4670a0-cd3b-4194-9808-9189e8698c5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:08.421926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4670a0-cd3b-4194-9808-9189e8698c5c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:08.445994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 233/477] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:18:08 2022] POST /identity/v3/users => generated 249 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:08.467405 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231bec5-8f88-4be2-8032-20d69b835e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:08.468114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bec5-8f88-4be2-8032-20d69b835e46 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:08.468398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bec5-8f88-4be2-8032-20d69b835e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:08.468671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bec5-8f88-4be2-8032-20d69b835e46 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:08.469471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231bec5-8f88-4be2-8032-20d69b835e46 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:08.470915 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231bec5-8f88-4be2-8032-20d69b835e46 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:08.486536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.sql.core [None req-e231bec5-8f88-4be2-8032-20d69b835e46 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 20:18:08.486536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 06 20:18:08.486536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [parameters: {'id': 'f53e1cfd1171452db420dcfdcf0bb6d4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 06 20:18:08.486536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80332) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e231bec5-8f88-4be2-8032-20d69b835e46 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 06 20:18:08.511447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return ref.to_dict() Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:18:08.512401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application yield resource Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise self.value Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application session.commit() Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 20:18:08.513329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.flush() Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application compat.raise_( Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 20:18:08.514810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:18:08.515767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:18:08.516613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [parameters: {'id': 'f53e1cfd1171452db420dcfdcf0bb6d4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:08.518665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 06 20:18:08.520610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:08.524354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 245/478] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Jul 6 20:18:08 2022] POST /identity/v3/roles => generated 144 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:08.524529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4670a0-cd3b-4194-9808-9189e8698c5c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:08.613328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:08.654449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4670a0-cd3b-4194-9808-9189e8698c5c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:08.689507 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d524845-283c-4ba8-a35a-b7a3bbbbfa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:08.690715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d524845-283c-4ba8-a35a-b7a3bbbbfa79 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:08.691193 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d524845-283c-4ba8-a35a-b7a3bbbbfa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:08.691658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d524845-283c-4ba8-a35a-b7a3bbbbfa79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:08.702727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d524845-283c-4ba8-a35a-b7a3bbbbfa79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2d524845-283c-4ba8-a35a-b7a3bbbbfa79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:08.711344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:08.712718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:18:08.713555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:08.716301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 234/479] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:08.722468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231bec5-8f88-4be2-8032-20d69b835e46 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:08.842252 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231bec5-8f88-4be2-8032-20d69b835e46 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:08.874500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:08.881053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd826a2-f7e8-441c-8475-0a4c9ffaa6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:08.881807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd826a2-f7e8-441c-8475-0a4c9ffaa6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:08.882410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd826a2-f7e8-441c-8475-0a4c9ffaa6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:08.882663 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd826a2-f7e8-441c-8475-0a4c9ffaa6a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:08.883443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd826a2-f7e8-441c-8475-0a4c9ffaa6a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:08.883780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd826a2-f7e8-441c-8475-0a4c9ffaa6a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:08.885598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd826a2-f7e8-441c-8475-0a4c9ffaa6a4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:08.894558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 246/480] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:10.110388 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e95ba-7660-468c-b5a5-39762c5e7a6c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:10.110904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e95ba-7660-468c-b5a5-39762c5e7a6c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:10.110904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e95ba-7660-468c-b5a5-39762c5e7a6c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:10.112483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 235/481] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:10.114971 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1ddad-9d22-4c5d-9ec2-e998fa250e28 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:10.115374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1ddad-9d22-4c5d-9ec2-e998fa250e28 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:10.115558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1ddad-9d22-4c5d-9ec2-e998fa250e28 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:10.117799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 247/482] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:10.122980 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92e3e-688b-4803-be88-fcf9572fce71 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:10.123268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92e3e-688b-4803-be88-fcf9572fce71 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:10.123550 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92e3e-688b-4803-be88-fcf9572fce71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:10.124896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54c2b-7ae6-4045-b05d-9794473b0cf0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:10.125211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54c2b-7ae6-4045-b05d-9794473b0cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:10.125487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54c2b-7ae6-4045-b05d-9794473b0cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:10.151295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a9b92e3e-688b-4803-be88-fcf9572fce71 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:10.152833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a9b92e3e-688b-4803-be88-fcf9572fce71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:10.163282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-10e54c2b-7ae6-4045-b05d-9794473b0cf0 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:10.164471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-10e54c2b-7ae6-4045-b05d-9794473b0cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:10.258766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 236/483] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:18:10.279782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b92e3e-688b-4803-be88-fcf9572fce71 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:10.295499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 248/484] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:10.321050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e54c2b-7ae6-4045-b05d-9794473b0cf0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:10.349303 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:10.453992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e54c2b-7ae6-4045-b05d-9794473b0cf0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:10.476728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b92e3e-688b-4803-be88-fcf9572fce71 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:10.478596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:10.496364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb3b54-8d2a-4dfc-b9f3-b10d8b2d2de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:10.497199 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb3b54-8d2a-4dfc-b9f3-b10d8b2d2de3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:10.497482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb3b54-8d2a-4dfc-b9f3-b10d8b2d2de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:10.497763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb3b54-8d2a-4dfc-b9f3-b10d8b2d2de3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:10.516662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb3b54-8d2a-4dfc-b9f3-b10d8b2d2de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1ccb3b54-8d2a-4dfc-b9f3-b10d8b2d2de3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:10.524822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:10.526297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:10.527114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 249/485] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:10.534593 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb3b54-8d2a-4dfc-b9f3-b10d8b2d2de3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:10.538095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31502263-20fa-47b2-96d5-0e8e873f5121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:10.538902 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31502263-20fa-47b2-96d5-0e8e873f5121 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:10.539179 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31502263-20fa-47b2-96d5-0e8e873f5121 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:10.539447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31502263-20fa-47b2-96d5-0e8e873f5121 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:10.551241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31502263-20fa-47b2-96d5-0e8e873f5121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-31502263-20fa-47b2-96d5-0e8e873f5121 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:10.560172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:10.561150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:10.561955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:10.562587 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 237/486] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:10.568342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31502263-20fa-47b2-96d5-0e8e873f5121 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:10.730490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb3b54-8d2a-4dfc-b9f3-b10d8b2d2de3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:10.743727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31502263-20fa-47b2-96d5-0e8e873f5121 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:10.751806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:10.788983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae8bba-43f9-4d38-9f7f-00434e630adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:10.789669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8bba-43f9-4d38-9f7f-00434e630adb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:10.789775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312a82-e4e3-4bcc-8d67-89e37d478ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:10.789978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8bba-43f9-4d38-9f7f-00434e630adb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:10.790218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8bba-43f9-4d38-9f7f-00434e630adb None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:10.790991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae8bba-43f9-4d38-9f7f-00434e630adb None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:10.791220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312a82-e4e3-4bcc-8d67-89e37d478ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:10.791315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae8bba-43f9-4d38-9f7f-00434e630adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:10.791757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312a82-e4e3-4bcc-8d67-89e37d478ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:10.792206 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312a82-e4e3-4bcc-8d67-89e37d478ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:10.792669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae8bba-43f9-4d38-9f7f-00434e630adb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:10.793379 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312a82-e4e3-4bcc-8d67-89e37d478ea8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:10.793922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312a82-e4e3-4bcc-8d67-89e37d478ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:10.795436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312a82-e4e3-4bcc-8d67-89e37d478ea8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:10.803023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 238/487] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:10.808579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648e4e-83ff-4220-b457-d6a4ef1aa595 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:10.808579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648e4e-83ff-4220-b457-d6a4ef1aa595 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:10.808579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648e4e-83ff-4220-b457-d6a4ef1aa595 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:10.809640 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 250/489] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:10.810523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 239/489] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:10.811668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087086f-cc93-444b-8ddd-69212ff6801a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:10.811958 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087086f-cc93-444b-8ddd-69212ff6801a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:10.813130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312a82-e4e3-4bcc-8d67-89e37d478ea8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:10.813458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087086f-cc93-444b-8ddd-69212ff6801a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:10.839194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5087086f-cc93-444b-8ddd-69212ff6801a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:10.841099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5087086f-cc93-444b-8ddd-69212ff6801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:10.880231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:10.911794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 240/490] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:10.912924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087086f-cc93-444b-8ddd-69212ff6801a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:10.957343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312a82-e4e3-4bcc-8d67-89e37d478ea8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:10.991457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2642cd-d2ae-4320-864b-0e4f96418530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:10.992469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2642cd-d2ae-4320-864b-0e4f96418530 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:10.992883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2642cd-d2ae-4320-864b-0e4f96418530 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:10.993335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2642cd-d2ae-4320-864b-0e4f96418530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.004214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2642cd-d2ae-4320-864b-0e4f96418530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:11.005844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2642cd-d2ae-4320-864b-0e4f96418530 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0d2642cd-d2ae-4320-864b-0e4f96418530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:11.023768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:11.024720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:11.025590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:11.025590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:11.025590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:11.025590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:11.027762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 251/491] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:11.033008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2642cd-d2ae-4320-864b-0e4f96418530 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:11.039326 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:11.046780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087086f-cc93-444b-8ddd-69212ff6801a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:11.084787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884345f-0bd7-4668-9b35-2f23b27c0784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:11.085604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884345f-0bd7-4668-9b35-2f23b27c0784 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.085882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884345f-0bd7-4668-9b35-2f23b27c0784 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.086151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884345f-0bd7-4668-9b35-2f23b27c0784 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.096941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884345f-0bd7-4668-9b35-2f23b27c0784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:11.098827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884345f-0bd7-4668-9b35-2f23b27c0784 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f884345f-0bd7-4668-9b35-2f23b27c0784 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:11.116523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:11.117836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:11.118684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:11.118684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:11.118684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:11.118684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:11.118684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 241/492] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:11.119688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884345f-0bd7-4668-9b35-2f23b27c0784 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:11.150167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:11.153869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2642cd-d2ae-4320-864b-0e4f96418530 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:11.190339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28194a-8dc1-4ddf-94fb-4d7c8e3d6e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:11.191139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28194a-8dc1-4ddf-94fb-4d7c8e3d6e25 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.191420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28194a-8dc1-4ddf-94fb-4d7c8e3d6e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.192369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28194a-8dc1-4ddf-94fb-4d7c8e3d6e25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.202108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28194a-8dc1-4ddf-94fb-4d7c8e3d6e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-fd28194a-8dc1-4ddf-94fb-4d7c8e3d6e25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:11.210587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:11.211536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:11.212372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:11.213008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 252/493] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:11.214083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a05bd4-0f8e-46ea-82d1-67e24ff16c52 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.214444 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a05bd4-0f8e-46ea-82d1-67e24ff16c52 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.214724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a05bd4-0f8e-46ea-82d1-67e24ff16c52 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.216270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 253/494] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:11.221577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a05bd4-0f8e-46ea-82d1-67e24ff16c52 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:11.229543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884345f-0bd7-4668-9b35-2f23b27c0784 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:11.265406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc6ef0-b4d8-44de-a0ba-d2acecdd48da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:11.266011 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc6ef0-b4d8-44de-a0ba-d2acecdd48da None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.266288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc6ef0-b4d8-44de-a0ba-d2acecdd48da None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.266558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc6ef0-b4d8-44de-a0ba-d2acecdd48da None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.267286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc6ef0-b4d8-44de-a0ba-d2acecdd48da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:11.267584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc6ef0-b4d8-44de-a0ba-d2acecdd48da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:11.268971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc6ef0-b4d8-44de-a0ba-d2acecdd48da None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:11.281650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 242/495] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:11.285841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc6ef0-b4d8-44de-a0ba-d2acecdd48da None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:11.297995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:11.330322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a05bd4-0f8e-46ea-82d1-67e24ff16c52 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:11.365075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab57c8d-c2fb-4321-a699-a9a0de509f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:11.365749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57c8d-c2fb-4321-a699-a9a0de509f26 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.366081 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57c8d-c2fb-4321-a699-a9a0de509f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.366359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57c8d-c2fb-4321-a699-a9a0de509f26 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.367077 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab57c8d-c2fb-4321-a699-a9a0de509f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:11.367388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab57c8d-c2fb-4321-a699-a9a0de509f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:11.368760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab57c8d-c2fb-4321-a699-a9a0de509f26 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:11.380860 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 254/496] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:11.386929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7872-bc61-4149-86ea-bd0d66eecfcb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.387732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7872-bc61-4149-86ea-bd0d66eecfcb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.388166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7872-bc61-4149-86ea-bd0d66eecfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.389324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc6ef0-b4d8-44de-a0ba-d2acecdd48da None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:11.409208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-467e7872-bc61-4149-86ea-bd0d66eecfcb None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:11.411354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-467e7872-bc61-4149-86ea-bd0d66eecfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:11.424194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90461-9ece-4d53-856d-74866d3f6a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:11.424858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90461-9ece-4d53-856d-74866d3f6a0a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.425163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90461-9ece-4d53-856d-74866d3f6a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.425432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90461-9ece-4d53-856d-74866d3f6a0a None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.426223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a90461-9ece-4d53-856d-74866d3f6a0a None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:11.426478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a90461-9ece-4d53-856d-74866d3f6a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:11.427845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a90461-9ece-4d53-856d-74866d3f6a0a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:11.429388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:11.436447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 243/497] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:11.437214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90461-9ece-4d53-856d-74866d3f6a0a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:11.485461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 255/498] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:11.486604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7872-bc61-4149-86ea-bd0d66eecfcb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:11.531923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:11.565489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90461-9ece-4d53-856d-74866d3f6a0a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:11.593022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7872-bc61-4149-86ea-bd0d66eecfcb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:11.601459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8bdb8-cce6-443d-9ed2-2254c9781ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:11.602253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8bdb8-cce6-443d-9ed2-2254c9781ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.602536 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8bdb8-cce6-443d-9ed2-2254c9781ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.602818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8bdb8-cce6-443d-9ed2-2254c9781ad4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.610327 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8bdb8-cce6-443d-9ed2-2254c9781ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:11.611784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8bdb8-cce6-443d-9ed2-2254c9781ad4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fce8bdb8-cce6-443d-9ed2-2254c9781ad4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:11.628157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:11.629249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:11.630122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:11.630122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:11.630122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:11.630122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:11.630122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:11.630122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:11.630122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:11.630122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:11.630122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:11.630122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:11.630122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 244/499] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Jul 6 20:18:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:11.630690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f3dae-85f8-4e02-8590-3086a9a00cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:11.630775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8bdb8-cce6-443d-9ed2-2254c9781ad4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:11.630841 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3dae-85f8-4e02-8590-3086a9a00cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.630913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3dae-85f8-4e02-8590-3086a9a00cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.631191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3dae-85f8-4e02-8590-3086a9a00cd0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.640086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f3dae-85f8-4e02-8590-3086a9a00cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:11.641602 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f3dae-85f8-4e02-8590-3086a9a00cd0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7e4f3dae-85f8-4e02-8590-3086a9a00cd0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:11.657470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:11.658517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 256/500] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:11.659396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f3dae-85f8-4e02-8590-3086a9a00cd0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:11.669848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:11.733563 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8bdb8-cce6-443d-9ed2-2254c9781ad4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:11.758083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f3dae-85f8-4e02-8590-3086a9a00cd0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:11.763120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:11.769327 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a2ef8-e152-44f7-a37b-56808095e6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:11.770123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a2ef8-e152-44f7-a37b-56808095e6dc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.770405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a2ef8-e152-44f7-a37b-56808095e6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.770677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a2ef8-e152-44f7-a37b-56808095e6dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.780808 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a2ef8-e152-44f7-a37b-56808095e6dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:11.782370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a2ef8-e152-44f7-a37b-56808095e6dc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:11.792278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b14cc-a1ea-46d0-ab4e-2a41608860f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:11.793088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b14cc-a1ea-46d0-ab4e-2a41608860f3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.793365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b14cc-a1ea-46d0-ab4e-2a41608860f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.793635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b14cc-a1ea-46d0-ab4e-2a41608860f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ad2a2ef8-e152-44f7-a37b-56808095e6dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:11.799934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:11.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:11.801904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:11.801904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:11.801904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:11.801904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:11.801904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 245/501] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:11.802678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b681eb0-541c-4000-af93-e30c2aadef9d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.802968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b681eb0-541c-4000-af93-e30c2aadef9d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.803243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b681eb0-541c-4000-af93-e30c2aadef9d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.804533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 246/502] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:11.805252 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b681eb0-541c-4000-af93-e30c2aadef9d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:11.809587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b14cc-a1ea-46d0-ab4e-2a41608860f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-eb1b14cc-a1ea-46d0-ab4e-2a41608860f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:11.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:11.818343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:11.819209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:11.820248 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 257/503] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:11.821228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b14cc-a1ea-46d0-ab4e-2a41608860f3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:11.889281 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:11.911171 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b681eb0-541c-4000-af93-e30c2aadef9d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:11.922956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b14cc-a1ea-46d0-ab4e-2a41608860f3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:11.944037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fec6e-f48a-4453-867e-567245d98931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:11.944708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fec6e-f48a-4453-867e-567245d98931 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.945011 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fec6e-f48a-4453-867e-567245d98931 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.945294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fec6e-f48a-4453-867e-567245d98931 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.946145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fec6e-f48a-4453-867e-567245d98931 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:11.946448 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fec6e-f48a-4453-867e-567245d98931 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:11.947876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fec6e-f48a-4453-867e-567245d98931 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:11.955314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de478f-19a4-426c-a547-264bc61e0b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:11.955972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de478f-19a4-426c-a547-264bc61e0b64 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.956247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de478f-19a4-426c-a547-264bc61e0b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.956513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de478f-19a4-426c-a547-264bc61e0b64 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:11.957374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de478f-19a4-426c-a547-264bc61e0b64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:11.957679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de478f-19a4-426c-a547-264bc61e0b64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:11.959092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de478f-19a4-426c-a547-264bc61e0b64 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:11.983541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 247/504] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jul 6 20:18:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:11.984408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fec6e-f48a-4453-867e-567245d98931 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:11.996628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 258/505] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Jul 6 20:18:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:11.998146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71f700-8a9e-499b-8cd1-4a248db3e8f4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:11.998439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71f700-8a9e-499b-8cd1-4a248db3e8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:11.998720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71f700-8a9e-499b-8cd1-4a248db3e8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:12.016800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7a71f700-8a9e-499b-8cd1-4a248db3e8f4 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:12.018286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7a71f700-8a9e-499b-8cd1-4a248db3e8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:12.025942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:12.081429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fec6e-f48a-4453-867e-567245d98931 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:12.092168 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 259/506] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:12.093179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71f700-8a9e-499b-8cd1-4a248db3e8f4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:12.116747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662bbfd-6742-40f6-8bfb-fe0d6d9f2b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:12.117453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662bbfd-6742-40f6-8bfb-fe0d6d9f2b61 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:12.117734 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662bbfd-6742-40f6-8bfb-fe0d6d9f2b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:12.118010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662bbfd-6742-40f6-8bfb-fe0d6d9f2b61 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:12.118747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662bbfd-6742-40f6-8bfb-fe0d6d9f2b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:12.119062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662bbfd-6742-40f6-8bfb-fe0d6d9f2b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:12.120476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662bbfd-6742-40f6-8bfb-fe0d6d9f2b61 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:12.132314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 248/507] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:12.133140 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662bbfd-6742-40f6-8bfb-fe0d6d9f2b61 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:12.153487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:12.196608 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71f700-8a9e-499b-8cd1-4a248db3e8f4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:12.227157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:12.230402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662bbfd-6742-40f6-8bfb-fe0d6d9f2b61 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:12.231641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713ed09-c163-4e78-810d-f66c104c6721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:12.232308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713ed09-c163-4e78-810d-f66c104c6721 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:12.232582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713ed09-c163-4e78-810d-f66c104c6721 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:12.232855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713ed09-c163-4e78-810d-f66c104c6721 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:12.233631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713ed09-c163-4e78-810d-f66c104c6721 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:12.233928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713ed09-c163-4e78-810d-f66c104c6721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:12.235304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713ed09-c163-4e78-810d-f66c104c6721 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:12.243293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 260/508] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:12.244269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713ed09-c163-4e78-810d-f66c104c6721 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:12.265470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54644c7-d546-48e3-a6ea-9099d3517f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:12.266117 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54644c7-d546-48e3-a6ea-9099d3517f97 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:12.266396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54644c7-d546-48e3-a6ea-9099d3517f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:12.266674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54644c7-d546-48e3-a6ea-9099d3517f97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:12.334157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54644c7-d546-48e3-a6ea-9099d3517f97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:12.335612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54644c7-d546-48e3-a6ea-9099d3517f97 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:12.340946 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713ed09-c163-4e78-810d-f66c104c6721 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:12.357356 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:12.374182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb44d2-21ee-4d68-a801-491e655b03d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:12.374828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb44d2-21ee-4d68-a801-491e655b03d7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:12.375105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb44d2-21ee-4d68-a801-491e655b03d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:12.375370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb44d2-21ee-4d68-a801-491e655b03d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:12.426566 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:12.430469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 249/509] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:12.431631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54644c7-d546-48e3-a6ea-9099d3517f97 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:12.441738 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb44d2-21ee-4d68-a801-491e655b03d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:12.443225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb44d2-21ee-4d68-a801-491e655b03d7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:12.533648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54644c7-d546-48e3-a6ea-9099d3517f97 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:12.549193 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 261/510] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:12.550224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb44d2-21ee-4d68-a801-491e655b03d7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:12.566505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6eee-214f-414f-810c-9b967b7bfd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:12.567386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6eee-214f-414f-810c-9b967b7bfd32 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:12.567733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6eee-214f-414f-810c-9b967b7bfd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:12.568071 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6eee-214f-414f-810c-9b967b7bfd32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:12.569361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:12.578754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6eee-214f-414f-810c-9b967b7bfd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:12.580197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6eee-214f-414f-810c-9b967b7bfd32 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-06db6eee-214f-414f-810c-9b967b7bfd32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:12.597462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:12.598344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:12.599177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:12.599177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:12.599177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:12.599177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:12.599177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 250/511] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:12.599437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6eee-214f-414f-810c-9b967b7bfd32 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:12.650225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:12.653782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb44d2-21ee-4d68-a801-491e655b03d7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:12.686784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee80a9f-4888-4695-a484-919ecd029ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:12.687572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee80a9f-4888-4695-a484-919ecd029ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:12.687859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee80a9f-4888-4695-a484-919ecd029ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:12.688119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee80a9f-4888-4695-a484-919ecd029ff9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:12.695285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee80a9f-4888-4695-a484-919ecd029ff9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:12.696719 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee80a9f-4888-4695-a484-919ecd029ff9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:12.697584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6eee-214f-414f-810c-9b967b7bfd32 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bee80a9f-4888-4695-a484-919ecd029ff9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:12.710978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:12.711938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:12.712829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:12.712829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:12.712829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:12.712829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:12.712829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:12.712829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:12.712829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:12.712829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:12.712829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:18:12.712829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:12.712829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 262/512] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:12.713422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee80a9f-4888-4695-a484-919ecd029ff9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:12.734806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b322e-9e44-42e7-95c4-0afe3c5c7629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:12.735618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b322e-9e44-42e7-95c4-0afe3c5c7629 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:12.735881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b322e-9e44-42e7-95c4-0afe3c5c7629 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:12.736146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b322e-9e44-42e7-95c4-0afe3c5c7629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:12.746872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b322e-9e44-42e7-95c4-0afe3c5c7629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:12.748338 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b322e-9e44-42e7-95c4-0afe3c5c7629 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-892b322e-9e44-42e7-95c4-0afe3c5c7629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:12.766248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:12.767190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:12.772666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:12.772666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:12.772666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:12.772666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:12.772666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 251/513] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:12.772666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b322e-9e44-42e7-95c4-0afe3c5c7629 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:12.795670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:12.818491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee80a9f-4888-4695-a484-919ecd029ff9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:12.852114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acdc00-aa1e-43b3-9653-a0141c52b235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:12.852840 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdc00-aa1e-43b3-9653-a0141c52b235 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:12.853148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdc00-aa1e-43b3-9653-a0141c52b235 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:12.853417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdc00-aa1e-43b3-9653-a0141c52b235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:12.863386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acdc00-aa1e-43b3-9653-a0141c52b235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:12.864851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acdc00-aa1e-43b3-9653-a0141c52b235 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:12.873461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b322e-9e44-42e7-95c4-0afe3c5c7629 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:12.875737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-26acdc00-aa1e-43b3-9653-a0141c52b235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:12.882823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:12.883819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:12.886121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:12.886121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:12.886121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:12.886121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:12.886121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 263/514] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:12.886121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acdc00-aa1e-43b3-9653-a0141c52b235 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:12.914440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc889a5-d015-4fdc-b841-7fedd66492d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:12.915227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc889a5-d015-4fdc-b841-7fedd66492d1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:12.915503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc889a5-d015-4fdc-b841-7fedd66492d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:12.915775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc889a5-d015-4fdc-b841-7fedd66492d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:12.925953 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc889a5-d015-4fdc-b841-7fedd66492d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:12.927425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc889a5-d015-4fdc-b841-7fedd66492d1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ccc889a5-d015-4fdc-b841-7fedd66492d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:12.944777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:12.945788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:12.946652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:12.946652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:12.946652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:12.946652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:12.946652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 252/515] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:12.947051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc889a5-d015-4fdc-b841-7fedd66492d1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:12.984875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acdc00-aa1e-43b3-9653-a0141c52b235 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:13.015319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:13.021939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327d92f-d0ed-4471-951b-b880536a65e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:13.022697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d92f-d0ed-4471-951b-b880536a65e5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:13.022974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d92f-d0ed-4471-951b-b880536a65e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:13.023242 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d92f-d0ed-4471-951b-b880536a65e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:13.024001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327d92f-d0ed-4471-951b-b880536a65e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:13.024307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327d92f-d0ed-4471-951b-b880536a65e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:13.025770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327d92f-d0ed-4471-951b-b880536a65e5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:13.037119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 264/516] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:13.037887 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327d92f-d0ed-4471-951b-b880536a65e5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:13.046007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc889a5-d015-4fdc-b841-7fedd66492d1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:13.079737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e291e-b25e-4492-b966-91752d5b270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:13.080399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e291e-b25e-4492-b966-91752d5b270e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:13.080674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e291e-b25e-4492-b966-91752d5b270e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:13.080945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e291e-b25e-4492-b966-91752d5b270e None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:13.081807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e291e-b25e-4492-b966-91752d5b270e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:13.082110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e291e-b25e-4492-b966-91752d5b270e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:13.083547 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e291e-b25e-4492-b966-91752d5b270e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:13.099956 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 253/517] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Jul 6 20:18:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:13.100759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e291e-b25e-4492-b966-91752d5b270e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:13.114915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:13.138772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327d92f-d0ed-4471-951b-b880536a65e5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:13.173321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc1e24-8941-496d-a4c2-bb8afa079729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:13.173980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc1e24-8941-496d-a4c2-bb8afa079729 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:13.174260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc1e24-8941-496d-a4c2-bb8afa079729 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:13.174528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc1e24-8941-496d-a4c2-bb8afa079729 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:13.175247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc1e24-8941-496d-a4c2-bb8afa079729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:13.175551 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc1e24-8941-496d-a4c2-bb8afa079729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:13.176922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc1e24-8941-496d-a4c2-bb8afa079729 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:13.189049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 265/518] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:13.189836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc1e24-8941-496d-a4c2-bb8afa079729 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:13.202567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e291e-b25e-4492-b966-91752d5b270e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:13.236037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce645ee6-73a3-4cb1-87db-de1bbe92d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:13.236807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce645ee6-73a3-4cb1-87db-de1bbe92d5db None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:13.237145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce645ee6-73a3-4cb1-87db-de1bbe92d5db None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:13.237404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce645ee6-73a3-4cb1-87db-de1bbe92d5db None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:13.238126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce645ee6-73a3-4cb1-87db-de1bbe92d5db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:13.238434 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce645ee6-73a3-4cb1-87db-de1bbe92d5db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:13.239790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce645ee6-73a3-4cb1-87db-de1bbe92d5db None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:13.240587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:13.251264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 254/519] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:13.252117 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce645ee6-73a3-4cb1-87db-de1bbe92d5db None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:13.293076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc1e24-8941-496d-a4c2-bb8afa079729 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:13.326417 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:13.332179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12c3a-d876-4d8a-be10-ff974be676d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:13.332936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12c3a-d876-4d8a-be10-ff974be676d2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:13.333233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12c3a-d876-4d8a-be10-ff974be676d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:13.333503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12c3a-d876-4d8a-be10-ff974be676d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:13.334230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12c3a-d876-4d8a-be10-ff974be676d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:13.334533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12c3a-d876-4d8a-be10-ff974be676d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:13.335911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12c3a-d876-4d8a-be10-ff974be676d2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:13.347911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 266/520] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:13.348790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12c3a-d876-4d8a-be10-ff974be676d2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:13.352234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce645ee6-73a3-4cb1-87db-de1bbe92d5db None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:13.384791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fb1fb-720d-4d7d-86d9-2fa0a8f46819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:13.385415 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb1fb-720d-4d7d-86d9-2fa0a8f46819 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:13.385691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb1fb-720d-4d7d-86d9-2fa0a8f46819 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:13.385959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb1fb-720d-4d7d-86d9-2fa0a8f46819 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:13.386656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fb1fb-720d-4d7d-86d9-2fa0a8f46819 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:13.388072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fb1fb-720d-4d7d-86d9-2fa0a8f46819 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:13.407311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 255/521] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:18:13 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:13.408167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fb1fb-720d-4d7d-86d9-2fa0a8f46819 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:13.469896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12c3a-d876-4d8a-be10-ff974be676d2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:13.481545 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:13.509238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b97600-fe79-4853-9c61-25171418cac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:13.509902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b97600-fe79-4853-9c61-25171418cac7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:13.510188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b97600-fe79-4853-9c61-25171418cac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:13.510461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b97600-fe79-4853-9c61-25171418cac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:13.525524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fb1fb-720d-4d7d-86d9-2fa0a8f46819 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:13.563083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:13.571172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868778a-267c-4fc9-8e27-36e6db604e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:13.572237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868778a-267c-4fc9-8e27-36e6db604e49 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:13.572584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868778a-267c-4fc9-8e27-36e6db604e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:13.572998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868778a-267c-4fc9-8e27-36e6db604e49 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:13.582421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868778a-267c-4fc9-8e27-36e6db604e49 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:13.583943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868778a-267c-4fc9-8e27-36e6db604e49 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:13.588403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b97600-fe79-4853-9c61-25171418cac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:13.589873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b97600-fe79-4853-9c61-25171418cac7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9868778a-267c-4fc9-8e27-36e6db604e49 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:13.598987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:13.599888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:13.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:13.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:13.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:13.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:13.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:13.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:13.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:13.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:13.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:18:13.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:13.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 256/522] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:13.601945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868778a-267c-4fc9-8e27-36e6db604e49 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:13.702833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868778a-267c-4fc9-8e27-36e6db604e49 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:13.713848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 267/523] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:13.713848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b97600-fe79-4853-9c61-25171418cac7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:13.722871 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:13.743004 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d3fe6-5229-4922-a6d6-249d8a28f11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:13.743910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d3fe6-5229-4922-a6d6-249d8a28f11a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:13.744257 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d3fe6-5229-4922-a6d6-249d8a28f11a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:13.744597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d3fe6-5229-4922-a6d6-249d8a28f11a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:13.751638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d3fe6-5229-4922-a6d6-249d8a28f11a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:13.753300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d3fe6-5229-4922-a6d6-249d8a28f11a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b31d3fe6-5229-4922-a6d6-249d8a28f11a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:13.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:13.770342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:13.771511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:13.771511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:13.771511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:13.771511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:13.771511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:13.771511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:13.771511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:13.771511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:13.772603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 257/524] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:13.773243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d3fe6-5229-4922-a6d6-249d8a28f11a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:13.824070 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b97600-fe79-4853-9c61-25171418cac7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:13.835130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:13.864406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8ed1c-09f3-45f8-a7b7-2b64531b35ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:13.865349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8ed1c-09f3-45f8-a7b7-2b64531b35ad None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:13.865690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8ed1c-09f3-45f8-a7b7-2b64531b35ad None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:13.866078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8ed1c-09f3-45f8-a7b7-2b64531b35ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:13.874632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8ed1c-09f3-45f8-a7b7-2b64531b35ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:13.876587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8ed1c-09f3-45f8-a7b7-2b64531b35ad None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:13.888896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d3fe6-5229-4922-a6d6-249d8a28f11a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c0f8ed1c-09f3-45f8-a7b7-2b64531b35ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:13.891627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:13.892461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:13.893344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:13.893344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:13.893344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:13.893344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:13.893344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:13.893344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:13.893344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:13.893344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:13.893344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 268/525] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:13.893877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8ed1c-09f3-45f8-a7b7-2b64531b35ad None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:13.930280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b6e80-37c3-485e-92ac-4cde58eb18f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:13.930957 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b6e80-37c3-485e-92ac-4cde58eb18f6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:13.931238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b6e80-37c3-485e-92ac-4cde58eb18f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:13.931512 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b6e80-37c3-485e-92ac-4cde58eb18f6 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:13.932359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b6e80-37c3-485e-92ac-4cde58eb18f6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:13.932717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b6e80-37c3-485e-92ac-4cde58eb18f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:13.934127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b6e80-37c3-485e-92ac-4cde58eb18f6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:13.952774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 258/526] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Jul 6 20:18:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:13.953706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b6e80-37c3-485e-92ac-4cde58eb18f6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:13.971410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:14.005260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8ed1c-09f3-45f8-a7b7-2b64531b35ad None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:14.040327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b2925-f2fa-4e48-b3da-f227ec008fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:14.041161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b2925-f2fa-4e48-b3da-f227ec008fdf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:14.041434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b2925-f2fa-4e48-b3da-f227ec008fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:14.041702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b2925-f2fa-4e48-b3da-f227ec008fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:14.052353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b2925-f2fa-4e48-b3da-f227ec008fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:14.053863 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b2925-f2fa-4e48-b3da-f227ec008fdf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:14.068945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b6e80-37c3-485e-92ac-4cde58eb18f6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9d0b2925-f2fa-4e48-b3da-f227ec008fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:14.070908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:14.071856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:14.072851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:14.072851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:14.072851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:14.072851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:14.076594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 269/527] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:14.077455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b2925-f2fa-4e48-b3da-f227ec008fdf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:14.082608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:14.112349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17434a1-fc4a-4412-9b52-e53049ab7fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:14.113431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17434a1-fc4a-4412-9b52-e53049ab7fba None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:14.113957 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17434a1-fc4a-4412-9b52-e53049ab7fba None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:14.114233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17434a1-fc4a-4412-9b52-e53049ab7fba None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:14.115049 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17434a1-fc4a-4412-9b52-e53049ab7fba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:14.115351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17434a1-fc4a-4412-9b52-e53049ab7fba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:14.116827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17434a1-fc4a-4412-9b52-e53049ab7fba None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:14.141571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 259/528] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:14.141571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17434a1-fc4a-4412-9b52-e53049ab7fba None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:14.184793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b2925-f2fa-4e48-b3da-f227ec008fdf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:14.208693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:14.221090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2dd63-addc-406d-83ff-3230c6348b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:14.221758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2dd63-addc-406d-83ff-3230c6348b8e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:14.222039 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2dd63-addc-406d-83ff-3230c6348b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:14.222345 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2dd63-addc-406d-83ff-3230c6348b8e None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:14.223100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2dd63-addc-406d-83ff-3230c6348b8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:14.223409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2dd63-addc-406d-83ff-3230c6348b8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:14.225057 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2dd63-addc-406d-83ff-3230c6348b8e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:14.242859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 270/529] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:14.243483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2dd63-addc-406d-83ff-3230c6348b8e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:14.247930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17434a1-fc4a-4412-9b52-e53049ab7fba None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:14.283313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b55a89-faf9-4c18-84bd-74a9404ea81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:14.283966 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b55a89-faf9-4c18-84bd-74a9404ea81e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:14.284247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b55a89-faf9-4c18-84bd-74a9404ea81e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:14.284522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b55a89-faf9-4c18-84bd-74a9404ea81e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:14.321935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:14.348253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2dd63-addc-406d-83ff-3230c6348b8e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:14.364488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b55a89-faf9-4c18-84bd-74a9404ea81e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:14.366079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b55a89-faf9-4c18-84bd-74a9404ea81e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:14.384476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80701e-6f0a-4fb0-ad45-409e079c7578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:14.385168 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80701e-6f0a-4fb0-ad45-409e079c7578 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:14.385450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80701e-6f0a-4fb0-ad45-409e079c7578 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:14.385724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80701e-6f0a-4fb0-ad45-409e079c7578 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:14.386448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80701e-6f0a-4fb0-ad45-409e079c7578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:14.386755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80701e-6f0a-4fb0-ad45-409e079c7578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:14.388121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80701e-6f0a-4fb0-ad45-409e079c7578 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:14.404937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 271/530] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:14.404937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80701e-6f0a-4fb0-ad45-409e079c7578 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:14.451286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:14.478221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 260/531] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:14.478221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b55a89-faf9-4c18-84bd-74a9404ea81e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:14.519791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80701e-6f0a-4fb0-ad45-409e079c7578 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:14.552242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:14.557885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4373fd-d967-4052-9b8c-7deb0e88a906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:14.558554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4373fd-d967-4052-9b8c-7deb0e88a906 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:14.558836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4373fd-d967-4052-9b8c-7deb0e88a906 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:14.559110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4373fd-d967-4052-9b8c-7deb0e88a906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:14.559956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4373fd-d967-4052-9b8c-7deb0e88a906 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=56ad461f6dc54014a956e5c8a094352c) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:14.560273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4373fd-d967-4052-9b8c-7deb0e88a906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:14.562166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4373fd-d967-4052-9b8c-7deb0e88a906 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:14.569461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 272/532] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:14 2022] GET /identity/v3/role_assignments?user.id=56ad461f6dc54014a956e5c8a094352c&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:14.574907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4373fd-d967-4052-9b8c-7deb0e88a906 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:14.588630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b55a89-faf9-4c18-84bd-74a9404ea81e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:14.636870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b8554-ff68-43be-ae66-d6f1f852ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:14.637921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b8554-ff68-43be-ae66-d6f1f852ad06 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:14.638341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b8554-ff68-43be-ae66-d6f1f852ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:14.638946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b8554-ff68-43be-ae66-d6f1f852ad06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:14.640361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b8554-ff68-43be-ae66-d6f1f852ad06 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=16f53619b6994ae0a117549a67fa29a6) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:14.641134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b8554-ff68-43be-ae66-d6f1f852ad06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:14.642947 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b8554-ff68-43be-ae66-d6f1f852ad06 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:14.651846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 261/533] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:14 2022] GET /identity/v3/role_assignments?user.id=16f53619b6994ae0a117549a67fa29a6&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:14.653305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b8554-ff68-43be-ae66-d6f1f852ad06 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:14.693495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4373fd-d967-4052-9b8c-7deb0e88a906 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:14.701539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:14.739188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bb527-045d-46a2-8c42-2971e0a04d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:14.740377 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bb527-045d-46a2-8c42-2971e0a04d71 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:14.741029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bb527-045d-46a2-8c42-2971e0a04d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:14.741318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bb527-045d-46a2-8c42-2971e0a04d71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:14.752424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bb527-045d-46a2-8c42-2971e0a04d71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:14.754274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bb527-045d-46a2-8c42-2971e0a04d71 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-882bb527-045d-46a2-8c42-2971e0a04d71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:14.783592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:14.784554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:14.785439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:14.785439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:14.785439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:14.785439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:14.785439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:14.785439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:14.785439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:14.785439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:14.785439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 273/534] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:14.793154 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bb527-045d-46a2-8c42-2971e0a04d71 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:14.817095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b8554-ff68-43be-ae66-d6f1f852ad06 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:14.863443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:14.877905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0e92-9c37-43ec-bab5-012f6b32ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:14.878718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0e92-9c37-43ec-bab5-012f6b32ef6f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:14.879041 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0e92-9c37-43ec-bab5-012f6b32ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:14.879313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0e92-9c37-43ec-bab5-012f6b32ef6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:14.898848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f0e92-9c37-43ec-bab5-012f6b32ef6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:14.900350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f0e92-9c37-43ec-bab5-012f6b32ef6f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8a5f0e92-9c37-43ec-bab5-012f6b32ef6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:14.936037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:14.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:14.937844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:14.937844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:14.937844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:14.937844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:14.937844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 262/535] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:14.943157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0e92-9c37-43ec-bab5-012f6b32ef6f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:14.952153 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bb527-045d-46a2-8c42-2971e0a04d71 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:15.017793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357fa0-79f4-47d6-abcb-cc285a664aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:15.018484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357fa0-79f4-47d6-abcb-cc285a664aad None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:15.018787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357fa0-79f4-47d6-abcb-cc285a664aad None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:15.019064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357fa0-79f4-47d6-abcb-cc285a664aad None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:15.019879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64357fa0-79f4-47d6-abcb-cc285a664aad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:15.020190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64357fa0-79f4-47d6-abcb-cc285a664aad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:15.021664 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64357fa0-79f4-47d6-abcb-cc285a664aad None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:15.045533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 274/536] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:15.051948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357fa0-79f4-47d6-abcb-cc285a664aad None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:15.101600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:15.133398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0e92-9c37-43ec-bab5-012f6b32ef6f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:15.197499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9994090-4552-4cb4-9c50-cc21cc118dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:15.198227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9994090-4552-4cb4-9c50-cc21cc118dca None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:15.198563 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9994090-4552-4cb4-9c50-cc21cc118dca None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:15.198953 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9994090-4552-4cb4-9c50-cc21cc118dca None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:15.199982 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9994090-4552-4cb4-9c50-cc21cc118dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:15.200428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9994090-4552-4cb4-9c50-cc21cc118dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:15.202510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9994090-4552-4cb4-9c50-cc21cc118dca None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:15.233553 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357fa0-79f4-47d6-abcb-cc285a664aad None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:15.235436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 263/537] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:15.236352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9994090-4552-4cb4-9c50-cc21cc118dca None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:15.299302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac22c3-f328-4292-a15c-6a897396d8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:15.299876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac22c3-f328-4292-a15c-6a897396d8ed None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:15.300162 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac22c3-f328-4292-a15c-6a897396d8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:15.300422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac22c3-f328-4292-a15c-6a897396d8ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:15.301294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac22c3-f328-4292-a15c-6a897396d8ed None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=344585d4cf44449e8b040d635fe45c65) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:15.301606 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac22c3-f328-4292-a15c-6a897396d8ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:15.303046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac22c3-f328-4292-a15c-6a897396d8ed None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:15.313390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 275/538] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:15 2022] GET /identity/v3/role_assignments?user.id=344585d4cf44449e8b040d635fe45c65&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:15.334950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:15.373152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9994090-4552-4cb4-9c50-cc21cc118dca None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:15.424429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b4881-ff07-497c-a3d6-f4d0671156cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:15.425278 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b4881-ff07-497c-a3d6-f4d0671156cf None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:15.425563 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b4881-ff07-497c-a3d6-f4d0671156cf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:15.425841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b4881-ff07-497c-a3d6-f4d0671156cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:15.438373 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b4881-ff07-497c-a3d6-f4d0671156cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:15.439866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b4881-ff07-497c-a3d6-f4d0671156cf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-aa3b4881-ff07-497c-a3d6-f4d0671156cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:15.461533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:15.462439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:15.463274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:15.463274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:15.463274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:15.463274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:15.463274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:15.463274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:15.463274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:15.463274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:15.463274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 264/539] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:15.469017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac22c3-f328-4292-a15c-6a897396d8ed None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:15.586073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920942-1cdc-458e-9b77-8d0f919c9f55 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:15.586073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920942-1cdc-458e-9b77-8d0f919c9f55 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:15.586073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920942-1cdc-458e-9b77-8d0f919c9f55 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:15.588766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 265/540] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:15.593887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f873-3208-4470-a253-a1ae7e23d424 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:15.594277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f873-3208-4470-a253-a1ae7e23d424 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:15.594564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f873-3208-4470-a253-a1ae7e23d424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:15.611289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:15.625516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac22c3-f328-4292-a15c-6a897396d8ed None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:15.627614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6505f873-3208-4470-a253-a1ae7e23d424 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:15.629716 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6505f873-3208-4470-a253-a1ae7e23d424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:15.690433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa3ae-d86f-4544-8cfe-e3a8014f4adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:15.691094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa3ae-d86f-4544-8cfe-e3a8014f4adc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:15.691376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa3ae-d86f-4544-8cfe-e3a8014f4adc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:15.691648 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa3ae-d86f-4544-8cfe-e3a8014f4adc None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:15.692446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fa3ae-d86f-4544-8cfe-e3a8014f4adc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:15.692756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fa3ae-d86f-4544-8cfe-e3a8014f4adc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:15.694295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fa3ae-d86f-4544-8cfe-e3a8014f4adc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:15.719615 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 276/541] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:15.726910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa3ae-d86f-4544-8cfe-e3a8014f4adc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:15.760885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 266/542] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:18:15.842662 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505f873-3208-4470-a253-a1ae7e23d424 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:15.879855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa3ae-d86f-4544-8cfe-e3a8014f4adc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:15.904975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:15.952552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56951dea-cf52-491f-baa8-3b5ecdcb6e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:15.953599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56951dea-cf52-491f-baa8-3b5ecdcb6e03 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:15.955279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56951dea-cf52-491f-baa8-3b5ecdcb6e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:15.955982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56951dea-cf52-491f-baa8-3b5ecdcb6e03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:15.957860 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56951dea-cf52-491f-baa8-3b5ecdcb6e03 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=1c5ad3094ee04495a6ab82c92d458aca) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:15.958655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56951dea-cf52-491f-baa8-3b5ecdcb6e03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:15.961197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56951dea-cf52-491f-baa8-3b5ecdcb6e03 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:15.974782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 277/543] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:15 2022] GET /identity/v3/role_assignments?user.id=1c5ad3094ee04495a6ab82c92d458aca&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:16.012480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505f873-3208-4470-a253-a1ae7e23d424 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:16.056583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd480d6a-a156-42c6-9851-14d5d5983bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:16.057794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd480d6a-a156-42c6-9851-14d5d5983bfb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:16.058266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd480d6a-a156-42c6-9851-14d5d5983bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:16.058723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd480d6a-a156-42c6-9851-14d5d5983bfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:16.069969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd480d6a-a156-42c6-9851-14d5d5983bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fd480d6a-a156-42c6-9851-14d5d5983bfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:16.082189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:16.083134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:16.083911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:16.086726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 267/544] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:16.092505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56951dea-cf52-491f-baa8-3b5ecdcb6e03 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:16.112711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:16.221197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56951dea-cf52-491f-baa8-3b5ecdcb6e03 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:16.270297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec072a-a8ae-4750-8947-36f4a008c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:16.271078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec072a-a8ae-4750-8947-36f4a008c297 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:16.271263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec072a-a8ae-4750-8947-36f4a008c297 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:16.271534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec072a-a8ae-4750-8947-36f4a008c297 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:16.272349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec072a-a8ae-4750-8947-36f4a008c297 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:16.272652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec072a-a8ae-4750-8947-36f4a008c297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:16.274072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec072a-a8ae-4750-8947-36f4a008c297 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:16.291370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 278/545] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:16.296897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd480d6a-a156-42c6-9851-14d5d5983bfb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:16.404421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:16.412061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd480d6a-a156-42c6-9851-14d5d5983bfb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:16.458640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f7add-cbc7-4e95-a344-4c7d20ea0f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:16.459451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f7add-cbc7-4e95-a344-4c7d20ea0f69 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:16.459784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f7add-cbc7-4e95-a344-4c7d20ea0f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:16.460063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f7add-cbc7-4e95-a344-4c7d20ea0f69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:16.477484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f7add-cbc7-4e95-a344-4c7d20ea0f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:16.479007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f7add-cbc7-4e95-a344-4c7d20ea0f69 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ec3f7add-cbc7-4e95-a344-4c7d20ea0f69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:16.500917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:16.501844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:16.502668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:16.502668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:16.502668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:16.502668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:16.502668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 268/546] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:16.510276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec072a-a8ae-4750-8947-36f4a008c297 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:16.609805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:16.634123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec072a-a8ae-4750-8947-36f4a008c297 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:16.668007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695937b7-b7fb-4682-bb5c-339e82a8a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:16.669020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695937b7-b7fb-4682-bb5c-339e82a8a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:16.669471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695937b7-b7fb-4682-bb5c-339e82a8a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:16.669910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695937b7-b7fb-4682-bb5c-339e82a8a8f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:16.670821 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695937b7-b7fb-4682-bb5c-339e82a8a8f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:16.671305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695937b7-b7fb-4682-bb5c-339e82a8a8f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:16.672917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695937b7-b7fb-4682-bb5c-339e82a8a8f0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:16.688053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 279/547] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:16.696483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f7add-cbc7-4e95-a344-4c7d20ea0f69 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:16.867827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f7add-cbc7-4e95-a344-4c7d20ea0f69 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:16.915616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba8056-5165-4d50-98a7-a84721644919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:16.916437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8056-5165-4d50-98a7-a84721644919 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:16.916722 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8056-5165-4d50-98a7-a84721644919 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:16.917024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8056-5165-4d50-98a7-a84721644919 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:16.934942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba8056-5165-4d50-98a7-a84721644919 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:16.936344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba8056-5165-4d50-98a7-a84721644919 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b2ba8056-5165-4d50-98a7-a84721644919 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:16.955210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:16.956199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:16.957594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:16.957594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:16.957594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:16.957594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:16.957594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:16.957594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:16.957594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:16.957594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:16.957594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:16.957594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:16.957594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 269/548] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:16.962502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695937b7-b7fb-4682-bb5c-339e82a8a8f0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:17.015228 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2a08-72c0-4a8a-9f3a-b013109b6e15 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.015538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2a08-72c0-4a8a-9f3a-b013109b6e15 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.015786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2a08-72c0-4a8a-9f3a-b013109b6e15 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.018594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 270/549] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:17.022613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7457b2-df31-43ca-9921-edaf431be057 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.022893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7457b2-df31-43ca-9921-edaf431be057 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.023163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7457b2-df31-43ca-9921-edaf431be057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.053357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:17.061304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-de7457b2-df31-43ca-9921-edaf431be057 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:17.062813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-de7457b2-df31-43ca-9921-edaf431be057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:17.142964 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695937b7-b7fb-4682-bb5c-339e82a8a8f0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:17.161030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 271/550] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:17.162745 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8e85a-4879-4af8-862b-52034db426df None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.163246 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8e85a-4879-4af8-862b-52034db426df None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.163732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8e85a-4879-4af8-862b-52034db426df None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.166943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 272/551] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:17.171280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e9736-a056-47df-b066-60a152fdd9d0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.171769 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e9736-a056-47df-b066-60a152fdd9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.172230 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e9736-a056-47df-b066-60a152fdd9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.187805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08122493-8dd2-4be6-b2eb-26706f263590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:17.188408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08122493-8dd2-4be6-b2eb-26706f263590 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.188691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08122493-8dd2-4be6-b2eb-26706f263590 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.189016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08122493-8dd2-4be6-b2eb-26706f263590 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.189894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08122493-8dd2-4be6-b2eb-26706f263590 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:17.190206 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08122493-8dd2-4be6-b2eb-26706f263590 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:17.191730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08122493-8dd2-4be6-b2eb-26706f263590 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:17.194746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:17.198786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-981e9736-a056-47df-b066-60a152fdd9d0 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:17.200278 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-981e9736-a056-47df-b066-60a152fdd9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:17.211985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 280/552] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jul 6 20:18:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:17.212644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08122493-8dd2-4be6-b2eb-26706f263590 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:17.276443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 273/553] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:17.277885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e9736-a056-47df-b066-60a152fdd9d0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:17.343609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08122493-8dd2-4be6-b2eb-26706f263590 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:17.357858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:17.380930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cd019-2b9d-4d29-9d42-bb9cb8626415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:17.381799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd019-2b9d-4d29-9d42-bb9cb8626415 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.382390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd019-2b9d-4d29-9d42-bb9cb8626415 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.382665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd019-2b9d-4d29-9d42-bb9cb8626415 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.398747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cd019-2b9d-4d29-9d42-bb9cb8626415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:17.403228 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e9736-a056-47df-b066-60a152fdd9d0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-074cd019-2b9d-4d29-9d42-bb9cb8626415 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:17.407307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:17.408362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:17.409210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:17.412142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 281/554] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:17.413461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cd019-2b9d-4d29-9d42-bb9cb8626415 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:17.448433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82982707-4b25-477b-a773-a0cff2451f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:17.449113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82982707-4b25-477b-a773-a0cff2451f1f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.449334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82982707-4b25-477b-a773-a0cff2451f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.449615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82982707-4b25-477b-a773-a0cff2451f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.472628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:17.535219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cd019-2b9d-4d29-9d42-bb9cb8626415 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:17.537590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82982707-4b25-477b-a773-a0cff2451f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:17.539395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82982707-4b25-477b-a773-a0cff2451f1f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:17.578824 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c4172-473a-4a77-b6b2-32a94517dbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:17.579629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c4172-473a-4a77-b6b2-32a94517dbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.579912 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c4172-473a-4a77-b6b2-32a94517dbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.580190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c4172-473a-4a77-b6b2-32a94517dbd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.593980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c4172-473a-4a77-b6b2-32a94517dbd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-747c4172-473a-4a77-b6b2-32a94517dbd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:17.604557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:17.605727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 282/555] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:17.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c4172-473a-4a77-b6b2-32a94517dbd2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:17.617678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:17.665031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 274/556] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:17.666482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82982707-4b25-477b-a773-a0cff2451f1f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:17.732898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c4172-473a-4a77-b6b2-32a94517dbd2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:17.747186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:17.768836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cffc1-9b24-497f-b6bb-beb81b4bcc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:17.769535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cffc1-9b24-497f-b6bb-beb81b4bcc78 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.769791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cffc1-9b24-497f-b6bb-beb81b4bcc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.770087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cffc1-9b24-497f-b6bb-beb81b4bcc78 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.770839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cffc1-9b24-497f-b6bb-beb81b4bcc78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:17.771124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cffc1-9b24-497f-b6bb-beb81b4bcc78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:17.772564 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cffc1-9b24-497f-b6bb-beb81b4bcc78 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:17.780624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 283/557] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:17.781443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cffc1-9b24-497f-b6bb-beb81b4bcc78 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:17.792132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82982707-4b25-477b-a773-a0cff2451f1f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:17.841529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba2e55-e3a9-4448-ac8c-742187ac4c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:17.842477 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba2e55-e3a9-4448-ac8c-742187ac4c07 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.842910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba2e55-e3a9-4448-ac8c-742187ac4c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.843184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba2e55-e3a9-4448-ac8c-742187ac4c07 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.843947 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba2e55-e3a9-4448-ac8c-742187ac4c07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:17.844252 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba2e55-e3a9-4448-ac8c-742187ac4c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:17.845672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba2e55-e3a9-4448-ac8c-742187ac4c07 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:17.854287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 275/558] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:17.860163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747c315-a729-43a3-b1fd-33ba00c6b0d6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.860448 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747c315-a729-43a3-b1fd-33ba00c6b0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.860721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747c315-a729-43a3-b1fd-33ba00c6b0d6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.865129 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 276/559] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:17.865129 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747c315-a729-43a3-b1fd-33ba00c6b0d6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:17.888235 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cffc1-9b24-497f-b6bb-beb81b4bcc78 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:17.894145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:17.926569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1cb16-b137-4ebe-ade6-e60242ed0315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:17.927363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1cb16-b137-4ebe-ade6-e60242ed0315 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:17.927662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1cb16-b137-4ebe-ade6-e60242ed0315 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:17.927931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1cb16-b137-4ebe-ade6-e60242ed0315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:17.939710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1cb16-b137-4ebe-ade6-e60242ed0315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:17.941261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1cb16-b137-4ebe-ade6-e60242ed0315 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e1e1cb16-b137-4ebe-ade6-e60242ed0315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:17.958896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:17.959875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:17.960739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:17.960739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:17.960739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:17.960739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:17.960739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 284/560] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:17.961054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1cb16-b137-4ebe-ade6-e60242ed0315 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:17.979781 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747c315-a729-43a3-b1fd-33ba00c6b0d6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:17.993130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:18.016554 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaa42e-c5eb-466a-9f81-b8c103fc3763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:18.017383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa42e-c5eb-466a-9f81-b8c103fc3763 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.017661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa42e-c5eb-466a-9f81-b8c103fc3763 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.017930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa42e-c5eb-466a-9f81-b8c103fc3763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.028845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaa42e-c5eb-466a-9f81-b8c103fc3763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:18.030788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaa42e-c5eb-466a-9f81-b8c103fc3763 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f4eaa42e-c5eb-466a-9f81-b8c103fc3763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:18.047827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:18.048742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:18.049689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:18.049689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:18.049689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:18.049689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:18.049689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 277/561] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:18.050535 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841452b7-e8f4-406b-b8d1-00a045d77100 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.050814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841452b7-e8f4-406b-b8d1-00a045d77100 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.051082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841452b7-e8f4-406b-b8d1-00a045d77100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.069068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-841452b7-e8f4-406b-b8d1-00a045d77100 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:18.070259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-841452b7-e8f4-406b-b8d1-00a045d77100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:18.075406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1cb16-b137-4ebe-ade6-e60242ed0315 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:18.109485 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16582a-43ba-46c1-8196-3cadd1dcb2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:18.110290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16582a-43ba-46c1-8196-3cadd1dcb2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.110575 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16582a-43ba-46c1-8196-3cadd1dcb2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.110905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16582a-43ba-46c1-8196-3cadd1dcb2b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.121639 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16582a-43ba-46c1-8196-3cadd1dcb2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:18.123089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16582a-43ba-46c1-8196-3cadd1dcb2b6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5a16582a-43ba-46c1-8196-3cadd1dcb2b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:18.140610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:18.149902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:18.150823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:18.150823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:18.150823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:18.150823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:18.151062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 278/562] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:18.151062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841452b7-e8f4-406b-b8d1-00a045d77100 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:18.151190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 285/563] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:18.151190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16582a-43ba-46c1-8196-3cadd1dcb2b6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:18.163209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:18.235216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:18.255408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16582a-43ba-46c1-8196-3cadd1dcb2b6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:18.261433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841452b7-e8f4-406b-b8d1-00a045d77100 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:18.290710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5e633-000f-458e-a501-d844a10c65c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:18.291374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e633-000f-458e-a501-d844a10c65c5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.291668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e633-000f-458e-a501-d844a10c65c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.291936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e633-000f-458e-a501-d844a10c65c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.292665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5e633-000f-458e-a501-d844a10c65c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:18.292989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5e633-000f-458e-a501-d844a10c65c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:18.294415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5e633-000f-458e-a501-d844a10c65c5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:18.297723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac08e5d-8e08-43e9-ab42-6cc99d35a40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:18.298403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac08e5d-8e08-43e9-ab42-6cc99d35a40d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.298687 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac08e5d-8e08-43e9-ab42-6cc99d35a40d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.298964 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac08e5d-8e08-43e9-ab42-6cc99d35a40d None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.299706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac08e5d-8e08-43e9-ab42-6cc99d35a40d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:18.300014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac08e5d-8e08-43e9-ab42-6cc99d35a40d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:18.301883 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac08e5d-8e08-43e9-ab42-6cc99d35a40d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:18.306494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 286/564] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:18.310090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5e633-000f-458e-a501-d844a10c65c5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:18.314075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 279/565] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:18.315361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac08e5d-8e08-43e9-ab42-6cc99d35a40d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:18.384888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:18.411692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5e633-000f-458e-a501-d844a10c65c5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:18.414995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac08e5d-8e08-43e9-ab42-6cc99d35a40d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:18.444573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430fe08-e02f-433e-9ffe-c66ff7f8c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:18.445261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430fe08-e02f-433e-9ffe-c66ff7f8c043 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.445540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430fe08-e02f-433e-9ffe-c66ff7f8c043 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.445811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430fe08-e02f-433e-9ffe-c66ff7f8c043 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.446530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430fe08-e02f-433e-9ffe-c66ff7f8c043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:18.446831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430fe08-e02f-433e-9ffe-c66ff7f8c043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:18.447305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e34d5-e4df-4c97-b362-c9b32d18925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:18.448101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e34d5-e4df-4c97-b362-c9b32d18925b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.448256 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430fe08-e02f-433e-9ffe-c66ff7f8c043 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:18.448382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e34d5-e4df-4c97-b362-c9b32d18925b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.448657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e34d5-e4df-4c97-b362-c9b32d18925b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.456522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:18.459035 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e34d5-e4df-4c97-b362-c9b32d18925b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:18.460270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 287/566] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:18.461146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430fe08-e02f-433e-9ffe-c66ff7f8c043 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-937e34d5-e4df-4c97-b362-c9b32d18925b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:18.466791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:18.467733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:18.468559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 280/567] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:18.473900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04798c91-2b6d-4027-95ff-f50dd2d64c8e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.474182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04798c91-2b6d-4027-95ff-f50dd2d64c8e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.474453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04798c91-2b6d-4027-95ff-f50dd2d64c8e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.475727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 281/568] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:18.476417 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04798c91-2b6d-4027-95ff-f50dd2d64c8e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:18.574543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430fe08-e02f-433e-9ffe-c66ff7f8c043 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:18.574730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04798c91-2b6d-4027-95ff-f50dd2d64c8e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:18.603710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:18.608725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e9994-b6e1-4e3d-a518-e0cdf96855c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:18.609556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e9994-b6e1-4e3d-a518-e0cdf96855c2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.609835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e9994-b6e1-4e3d-a518-e0cdf96855c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.610040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8223f1-fd40-47d6-8d41-96ca5faf632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:18.610154 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e9994-b6e1-4e3d-a518-e0cdf96855c2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.610832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8223f1-fd40-47d6-8d41-96ca5faf632f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.611104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8223f1-fd40-47d6-8d41-96ca5faf632f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.611371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8223f1-fd40-47d6-8d41-96ca5faf632f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.617758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e9994-b6e1-4e3d-a518-e0cdf96855c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:18.618277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8223f1-fd40-47d6-8d41-96ca5faf632f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:18.619192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e9994-b6e1-4e3d-a518-e0cdf96855c2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:18.619694 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8223f1-fd40-47d6-8d41-96ca5faf632f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-fc2e9994-b6e1-4e3d-a518-e0cdf96855c2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:18.633338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:18.634433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:18.635400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:18.635400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:18.635400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:18.635400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:18.635400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:18.635400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:18.635400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:18.635400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:18.635400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:18:18.635400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4b8223f1-fd40-47d6-8d41-96ca5faf632f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:18.635968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:18.636741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:18.637627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:18.637627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:18.637627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:18.637627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:18.637627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:18.637627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:18.637627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:18.637627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:18.637627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 282/570] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:18.638115 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 288/570] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:18.638192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8223f1-fd40-47d6-8d41-96ca5faf632f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:18.638263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e9994-b6e1-4e3d-a518-e0cdf96855c2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:18.695645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:18.736287 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e9994-b6e1-4e3d-a518-e0cdf96855c2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:18.740089 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8223f1-fd40-47d6-8d41-96ca5faf632f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:18.769831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da479b8-747b-4fb6-81c1-b84c9fd43379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:18.770521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da479b8-747b-4fb6-81c1-b84c9fd43379 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.770802 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da479b8-747b-4fb6-81c1-b84c9fd43379 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.771074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da479b8-747b-4fb6-81c1-b84c9fd43379 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.771825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da479b8-747b-4fb6-81c1-b84c9fd43379 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:18.772163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da479b8-747b-4fb6-81c1-b84c9fd43379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:18.772723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99257c0b-70b5-41bb-bba3-a3243dd14333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:18.773563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da479b8-747b-4fb6-81c1-b84c9fd43379 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:18.773684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257c0b-70b5-41bb-bba3-a3243dd14333 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.773866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257c0b-70b5-41bb-bba3-a3243dd14333 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.774132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257c0b-70b5-41bb-bba3-a3243dd14333 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.781353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 289/571] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:18.781491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99257c0b-70b5-41bb-bba3-a3243dd14333 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:18.782592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1f36-2a9b-4e75-b0c9-f16f747ef9a6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.782852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99257c0b-70b5-41bb-bba3-a3243dd14333 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:18.782951 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1f36-2a9b-4e75-b0c9-f16f747ef9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.783199 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1f36-2a9b-4e75-b0c9-f16f747ef9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-99257c0b-70b5-41bb-bba3-a3243dd14333 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:18.799395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:18.800545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 283/572] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Jul 6 20:18:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:18.801541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99257c0b-70b5-41bb-bba3-a3243dd14333 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:18.803656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-217f1f36-2a9b-4e75-b0c9-f16f747ef9a6 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:18.804837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-217f1f36-2a9b-4e75-b0c9-f16f747ef9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:18.853375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:18.870220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 290/573] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:18.871046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1f36-2a9b-4e75-b0c9-f16f747ef9a6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:18.905599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99257c0b-70b5-41bb-bba3-a3243dd14333 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:18.927522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:18.938627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311af27-e307-46a8-a2a6-fc1469a036d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:18.939301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311af27-e307-46a8-a2a6-fc1469a036d3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:18.939582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311af27-e307-46a8-a2a6-fc1469a036d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:18.939857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311af27-e307-46a8-a2a6-fc1469a036d3 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:18.940702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311af27-e307-46a8-a2a6-fc1469a036d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:18.941042 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311af27-e307-46a8-a2a6-fc1469a036d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:18.942478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311af27-e307-46a8-a2a6-fc1469a036d3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:18.963664 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 284/574] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Jul 6 20:18:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:18.964504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311af27-e307-46a8-a2a6-fc1469a036d3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:18.976116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1f36-2a9b-4e75-b0c9-f16f747ef9a6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.009177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8568d-ed0a-41cc-87de-7d07b105b45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.009820 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8568d-ed0a-41cc-87de-7d07b105b45c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.010084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8568d-ed0a-41cc-87de-7d07b105b45c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.010350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8568d-ed0a-41cc-87de-7d07b105b45c None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.011125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8568d-ed0a-41cc-87de-7d07b105b45c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:19.011431 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8568d-ed0a-41cc-87de-7d07b105b45c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:19.012878 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8568d-ed0a-41cc-87de-7d07b105b45c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:19.024303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 291/575] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:19.025092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8568d-ed0a-41cc-87de-7d07b105b45c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:19.067098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311af27-e307-46a8-a2a6-fc1469a036d3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.076173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:19.100539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1ea65-ff25-4c3a-99db-a20a1cc72a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.101289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ea65-ff25-4c3a-99db-a20a1cc72a1b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.101563 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ea65-ff25-4c3a-99db-a20a1cc72a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.101833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ea65-ff25-4c3a-99db-a20a1cc72a1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.111882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1ea65-ff25-4c3a-99db-a20a1cc72a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:19.113747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1ea65-ff25-4c3a-99db-a20a1cc72a1b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:19.125701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8568d-ed0a-41cc-87de-7d07b105b45c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1cc1ea65-ff25-4c3a-99db-a20a1cc72a1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:19.130701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:19.131580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:19.132772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:19.132772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:19.132772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:19.132772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:19.132772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 285/576] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:19.133073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1ea65-ff25-4c3a-99db-a20a1cc72a1b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:19.143200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:19.163653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe4dd1-5b0d-4c22-b61d-33409f4b7d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.164310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe4dd1-5b0d-4c22-b61d-33409f4b7d26 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.164584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe4dd1-5b0d-4c22-b61d-33409f4b7d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.164854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe4dd1-5b0d-4c22-b61d-33409f4b7d26 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.165712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe4dd1-5b0d-4c22-b61d-33409f4b7d26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:19.166025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe4dd1-5b0d-4c22-b61d-33409f4b7d26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:19.167434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe4dd1-5b0d-4c22-b61d-33409f4b7d26 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:19.184015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 292/577] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:19.184781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe4dd1-5b0d-4c22-b61d-33409f4b7d26 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:19.234868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1ea65-ff25-4c3a-99db-a20a1cc72a1b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.267911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84372a9f-bdf0-4068-a6d4-aeb3a9209e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.268730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84372a9f-bdf0-4068-a6d4-aeb3a9209e63 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.269023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84372a9f-bdf0-4068-a6d4-aeb3a9209e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.269270 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84372a9f-bdf0-4068-a6d4-aeb3a9209e63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.279229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84372a9f-bdf0-4068-a6d4-aeb3a9209e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:19.283448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe4dd1-5b0d-4c22-b61d-33409f4b7d26 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-84372a9f-bdf0-4068-a6d4-aeb3a9209e63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:19.286842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:19.287904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:19.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:19.293107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 286/578] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:19.293859 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84372a9f-bdf0-4068-a6d4-aeb3a9209e63 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:19.315463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:19.316063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47608393-0f7b-4362-83d0-8904b5e13c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.316936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47608393-0f7b-4362-83d0-8904b5e13c72 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.317305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47608393-0f7b-4362-83d0-8904b5e13c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.317783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47608393-0f7b-4362-83d0-8904b5e13c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.328570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47608393-0f7b-4362-83d0-8904b5e13c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:19.330078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47608393-0f7b-4362-83d0-8904b5e13c72 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-47608393-0f7b-4362-83d0-8904b5e13c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:19.347505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:19.348418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:19.349320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:19.349320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:19.349320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:19.349320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:19.349320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 293/579] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:19.349621 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47608393-0f7b-4362-83d0-8904b5e13c72 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:19.373122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:19.396324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84372a9f-bdf0-4068-a6d4-aeb3a9209e63 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.428664 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6b28b-c8be-4d9a-b91d-7dc4f7047672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.429346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b28b-c8be-4d9a-b91d-7dc4f7047672 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.429645 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b28b-c8be-4d9a-b91d-7dc4f7047672 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.429917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b28b-c8be-4d9a-b91d-7dc4f7047672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.430746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6b28b-c8be-4d9a-b91d-7dc4f7047672 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=b11e395dab424f3492f092eb3d5032dd) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:19.431052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6b28b-c8be-4d9a-b91d-7dc4f7047672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:19.432470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6b28b-c8be-4d9a-b91d-7dc4f7047672 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:19.437854 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 287/580] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/role_assignments?user.id=b11e395dab424f3492f092eb3d5032dd&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:19.438634 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6b28b-c8be-4d9a-b91d-7dc4f7047672 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:19.459715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47608393-0f7b-4362-83d0-8904b5e13c72 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.499672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f03a63-a306-4204-8ff1-a37f7fe97c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.500328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f03a63-a306-4204-8ff1-a37f7fe97c57 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.500631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f03a63-a306-4204-8ff1-a37f7fe97c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.500892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f03a63-a306-4204-8ff1-a37f7fe97c57 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.501660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f03a63-a306-4204-8ff1-a37f7fe97c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:19.501969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f03a63-a306-4204-8ff1-a37f7fe97c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:19.503396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f03a63-a306-4204-8ff1-a37f7fe97c57 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:19.521267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 294/581] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:19.523090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f03a63-a306-4204-8ff1-a37f7fe97c57 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:19.532799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:19.551690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6b28b-c8be-4d9a-b91d-7dc4f7047672 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.601259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee7899-b237-4f01-8356-d28353f4deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.609192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee7899-b237-4f01-8356-d28353f4deb6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.609192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee7899-b237-4f01-8356-d28353f4deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.609192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee7899-b237-4f01-8356-d28353f4deb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.614722 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee7899-b237-4f01-8356-d28353f4deb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:19.616390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee7899-b237-4f01-8356-d28353f4deb6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:19.616801 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-54ee7899-b237-4f01-8356-d28353f4deb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:19.635471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:19.636397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:19.637310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:19.637310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:19.637310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:19.637310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:19.637523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f03a63-a306-4204-8ff1-a37f7fe97c57 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.641214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 288/582] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:19.642069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee7899-b237-4f01-8356-d28353f4deb6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:19.674880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd4dfa-56eb-4eb5-89f4-69fbe0187e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.675576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd4dfa-56eb-4eb5-89f4-69fbe0187e3a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.675843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd4dfa-56eb-4eb5-89f4-69fbe0187e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.676120 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd4dfa-56eb-4eb5-89f4-69fbe0187e3a None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.676876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd4dfa-56eb-4eb5-89f4-69fbe0187e3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:19.677238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd4dfa-56eb-4eb5-89f4-69fbe0187e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:19.678683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd4dfa-56eb-4eb5-89f4-69fbe0187e3a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:19.691449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 295/583] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:19.691449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd4dfa-56eb-4eb5-89f4-69fbe0187e3a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:19.749997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee7899-b237-4f01-8356-d28353f4deb6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.787356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edd4ae-0279-4aa3-ad38-898a9e77a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.788058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd4ae-0279-4aa3-ad38-898a9e77a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.788341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd4ae-0279-4aa3-ad38-898a9e77a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.788616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd4ae-0279-4aa3-ad38-898a9e77a9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.788998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd4dfa-56eb-4eb5-89f4-69fbe0187e3a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.789376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edd4ae-0279-4aa3-ad38-898a9e77a9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:19.789683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edd4ae-0279-4aa3-ad38-898a9e77a9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:19.791044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edd4ae-0279-4aa3-ad38-898a9e77a9b7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:19.793814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:19.805063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 289/584] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:19.805330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edd4ae-0279-4aa3-ad38-898a9e77a9b7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:19.834534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c8a3d-afe6-4e3e-ada0-25d9fc241732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.835332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8a3d-afe6-4e3e-ada0-25d9fc241732 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.835609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8a3d-afe6-4e3e-ada0-25d9fc241732 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.835879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8a3d-afe6-4e3e-ada0-25d9fc241732 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.843787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c8a3d-afe6-4e3e-ada0-25d9fc241732 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:19.845250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c8a3d-afe6-4e3e-ada0-25d9fc241732 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-578c8a3d-afe6-4e3e-ada0-25d9fc241732 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:19.859324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:19.860266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 296/585] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:19.866436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c8a3d-afe6-4e3e-ada0-25d9fc241732 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:19.870374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:19.920578 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edd4ae-0279-4aa3-ad38-898a9e77a9b7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.959225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91415d00-be72-4108-8d76-a1c2e3622674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:19.960311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91415d00-be72-4108-8d76-a1c2e3622674 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:19.960846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91415d00-be72-4108-8d76-a1c2e3622674 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:19.961408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91415d00-be72-4108-8d76-a1c2e3622674 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:19.962974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91415d00-be72-4108-8d76-a1c2e3622674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:19.963524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91415d00-be72-4108-8d76-a1c2e3622674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:19.965361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91415d00-be72-4108-8d76-a1c2e3622674 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:19.976788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c8a3d-afe6-4e3e-ada0-25d9fc241732 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:19.980064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 290/586] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:19.981106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91415d00-be72-4108-8d76-a1c2e3622674 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.018185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb42bb-c6d4-47cb-9242-48cc17683c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:20.018988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb42bb-c6d4-47cb-9242-48cc17683c2f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:20.019269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb42bb-c6d4-47cb-9242-48cc17683c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:20.019540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb42bb-c6d4-47cb-9242-48cc17683c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:20.031552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb42bb-c6d4-47cb-9242-48cc17683c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:20.033061 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb42bb-c6d4-47cb-9242-48cc17683c2f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:20.046083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b8bb42bb-c6d4-47cb-9242-48cc17683c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:20.050473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:20.051543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:20.052576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:20.052576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:20.052576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:20.052576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:20.056235 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 297/587] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:20.057056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb42bb-c6d4-47cb-9242-48cc17683c2f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.097739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91415d00-be72-4108-8d76-a1c2e3622674 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:20.117831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:20.132530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12905fb-7dbd-45ea-9038-c3d9c288a98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:20.133466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12905fb-7dbd-45ea-9038-c3d9c288a98d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:20.134497 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12905fb-7dbd-45ea-9038-c3d9c288a98d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:20.134497 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12905fb-7dbd-45ea-9038-c3d9c288a98d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:20.141173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12905fb-7dbd-45ea-9038-c3d9c288a98d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:20.142717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12905fb-7dbd-45ea-9038-c3d9c288a98d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a12905fb-7dbd-45ea-9038-c3d9c288a98d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:20.157775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:20.158768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:20.159773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:20.159773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:20.159773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:20.159773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:20.159773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:20.159773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:20.159773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:20.159773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:20.163929 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 291/588] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:20.164772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12905fb-7dbd-45ea-9038-c3d9c288a98d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.166365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb42bb-c6d4-47cb-9242-48cc17683c2f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:20.202229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35300cf9-e865-4bd4-9ec3-3583549c7fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:20.202830 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300cf9-e865-4bd4-9ec3-3583549c7fed None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:20.203107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300cf9-e865-4bd4-9ec3-3583549c7fed None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:20.203376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300cf9-e865-4bd4-9ec3-3583549c7fed None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:20.204240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35300cf9-e865-4bd4-9ec3-3583549c7fed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:20.204549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35300cf9-e865-4bd4-9ec3-3583549c7fed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:20.206001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35300cf9-e865-4bd4-9ec3-3583549c7fed None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:20.227110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 298/589] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Jul 6 20:18:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:20.227110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35300cf9-e865-4bd4-9ec3-3583549c7fed None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.270985 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12905fb-7dbd-45ea-9038-c3d9c288a98d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:20.288020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:20.307273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765087e-55e9-4396-9eae-fcc3980034a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:20.308070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765087e-55e9-4396-9eae-fcc3980034a1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:20.308351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765087e-55e9-4396-9eae-fcc3980034a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:20.308627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765087e-55e9-4396-9eae-fcc3980034a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:20.315638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765087e-55e9-4396-9eae-fcc3980034a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:20.317114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765087e-55e9-4396-9eae-fcc3980034a1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6765087e-55e9-4396-9eae-fcc3980034a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:20.330715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:20.331581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:20.332457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:20.332457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:20.332457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:20.332457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:20.332457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:20.332457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:20.332457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:20.332457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:20.332457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 292/590] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:20.332970 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765087e-55e9-4396-9eae-fcc3980034a1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.334119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35300cf9-e865-4bd4-9ec3-3583549c7fed None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:20.350695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:20.372225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33975eb8-18b8-4a86-bd87-34f0ba30e6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:20.372892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33975eb8-18b8-4a86-bd87-34f0ba30e6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:20.373200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33975eb8-18b8-4a86-bd87-34f0ba30e6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:20.373473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33975eb8-18b8-4a86-bd87-34f0ba30e6a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:20.374197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33975eb8-18b8-4a86-bd87-34f0ba30e6a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:20.374503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33975eb8-18b8-4a86-bd87-34f0ba30e6a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:20.376503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33975eb8-18b8-4a86-bd87-34f0ba30e6a6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:20.392100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 299/591] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:20.392100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33975eb8-18b8-4a86-bd87-34f0ba30e6a6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.446276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765087e-55e9-4396-9eae-fcc3980034a1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:20.484121 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea7017-f9d1-4621-a73d-4a6ba6e2371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:20.484785 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7017-f9d1-4621-a73d-4a6ba6e2371c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:20.485096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7017-f9d1-4621-a73d-4a6ba6e2371c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:20.485374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7017-f9d1-4621-a73d-4a6ba6e2371c None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:20.486169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea7017-f9d1-4621-a73d-4a6ba6e2371c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:20.486494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea7017-f9d1-4621-a73d-4a6ba6e2371c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:20.487927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea7017-f9d1-4621-a73d-4a6ba6e2371c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:20.496096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33975eb8-18b8-4a86-bd87-34f0ba30e6a6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:20.505048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 293/592] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:20.505048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea7017-f9d1-4621-a73d-4a6ba6e2371c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.536037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dae575-af83-4eee-a276-56b791471b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:20.536917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dae575-af83-4eee-a276-56b791471b75 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:20.537320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dae575-af83-4eee-a276-56b791471b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:20.537680 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dae575-af83-4eee-a276-56b791471b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:20.540024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:20.549476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dae575-af83-4eee-a276-56b791471b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:20.550999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dae575-af83-4eee-a276-56b791471b75 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-93dae575-af83-4eee-a276-56b791471b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:20.568113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:20.569224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:20.570271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:20.570271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:20.570271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:20.570271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:20.575733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 300/593] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:20.575733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dae575-af83-4eee-a276-56b791471b75 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.600781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:20.623948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea7017-f9d1-4621-a73d-4a6ba6e2371c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:20.658895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9d91-e391-49c3-ae15-fc3542aad240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:20.659660 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9d91-e391-49c3-ae15-fc3542aad240 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:20.660009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9d91-e391-49c3-ae15-fc3542aad240 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:20.660353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9d91-e391-49c3-ae15-fc3542aad240 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:20.661182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b9d91-e391-49c3-ae15-fc3542aad240 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:20.661493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b9d91-e391-49c3-ae15-fc3542aad240 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:20.662995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b9d91-e391-49c3-ae15-fc3542aad240 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:20.675047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 294/594] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:20.675805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9d91-e391-49c3-ae15-fc3542aad240 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.676232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dae575-af83-4eee-a276-56b791471b75 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:20.719711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b58aa8-d5d7-4ed7-921d-f67a4a2f28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:20.720521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b58aa8-d5d7-4ed7-921d-f67a4a2f28d2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:20.720803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b58aa8-d5d7-4ed7-921d-f67a4a2f28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:20.721138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b58aa8-d5d7-4ed7-921d-f67a4a2f28d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:20.728482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b58aa8-d5d7-4ed7-921d-f67a4a2f28d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:20.729970 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b58aa8-d5d7-4ed7-921d-f67a4a2f28d2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-70b58aa8-d5d7-4ed7-921d-f67a4a2f28d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:20.744789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:20.745898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:20.747010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:20.747010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:20.747010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:20.747010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:20.747010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:20.747010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:20.747010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:20.747010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:20.747010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:18:20.747010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:20.750415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 301/595] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:20.751209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b58aa8-d5d7-4ed7-921d-f67a4a2f28d2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.784013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:20.792162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9d91-e391-49c3-ae15-fc3542aad240 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:20.827474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94fd4d-f5f4-49fc-bf04-2df8462f7b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:20.828375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94fd4d-f5f4-49fc-bf04-2df8462f7b1d None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:20.828656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94fd4d-f5f4-49fc-bf04-2df8462f7b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:20.828930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94fd4d-f5f4-49fc-bf04-2df8462f7b1d None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/16f53619b6994ae0a117549a67fa29a6/roles/b464352c183141f4a1be0d9764ea4105` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:20.843772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94fd4d-f5f4-49fc-bf04-2df8462f7b1d None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=16f53619b6994ae0a117549a67fa29a6, role_id=b464352c183141f4a1be0d9764ea4105)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:20.845246 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94fd4d-f5f4-49fc-bf04-2df8462f7b1d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:20.852104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:20.869052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 295/596] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:18:20 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/16f53619b6994ae0a117549a67fa29a6/roles/b464352c183141f4a1be0d9764ea4105 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:18:20.869052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94fd4d-f5f4-49fc-bf04-2df8462f7b1d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.885833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b58aa8-d5d7-4ed7-921d-f67a4a2f28d2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:20.937509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa296a-daaa-4b49-a5f6-4ccba246fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:20.938634 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa296a-daaa-4b49-a5f6-4ccba246fb70 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:20.939012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa296a-daaa-4b49-a5f6-4ccba246fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:20.940012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa296a-daaa-4b49-a5f6-4ccba246fb70 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:20.941035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa296a-daaa-4b49-a5f6-4ccba246fb70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:20.941546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa296a-daaa-4b49-a5f6-4ccba246fb70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:20.944364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa296a-daaa-4b49-a5f6-4ccba246fb70 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:20.962012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 302/597] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:20.963188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa296a-daaa-4b49-a5f6-4ccba246fb70 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:20.981944 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94fd4d-f5f4-49fc-bf04-2df8462f7b1d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:21.024679 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cdda7-f812-4d52-9009-0fc29110b6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:21.025542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cdda7-f812-4d52-9009-0fc29110b6b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:21.025824 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cdda7-f812-4d52-9009-0fc29110b6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:21.026096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cdda7-f812-4d52-9009-0fc29110b6b7 None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/56ad461f6dc54014a956e5c8a094352c/roles/b464352c183141f4a1be0d9764ea4105` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:21.044249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cdda7-f812-4d52-9009-0fc29110b6b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=56ad461f6dc54014a956e5c8a094352c, role_id=b464352c183141f4a1be0d9764ea4105)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:21.046573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cdda7-f812-4d52-9009-0fc29110b6b7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:21.051400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:21.068821 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 296/598] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:18:20 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/56ad461f6dc54014a956e5c8a094352c/roles/b464352c183141f4a1be0d9764ea4105 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:18:21.069505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cdda7-f812-4d52-9009-0fc29110b6b7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:21.110706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa296a-daaa-4b49-a5f6-4ccba246fb70 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:21.187296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848f868-96bb-492e-9bef-b505b61b3a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:21.187653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848f868-96bb-492e-9bef-b505b61b3a5a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:21.187919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848f868-96bb-492e-9bef-b505b61b3a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:21.188260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848f868-96bb-492e-9bef-b505b61b3a5a None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:21.189219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848f868-96bb-492e-9bef-b505b61b3a5a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:21.189635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848f868-96bb-492e-9bef-b505b61b3a5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:21.190998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848f868-96bb-492e-9bef-b505b61b3a5a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:21.206106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cdda7-f812-4d52-9009-0fc29110b6b7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:21.213400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 303/599] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Jul 6 20:18:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:21.219190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848f868-96bb-492e-9bef-b505b61b3a5a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:21.224169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:21.264873 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ed3f9-61c9-4594-a89e-2951fc85d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:21.265757 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ed3f9-61c9-4594-a89e-2951fc85d035 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:21.266043 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ed3f9-61c9-4594-a89e-2951fc85d035 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:21.266312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ed3f9-61c9-4594-a89e-2951fc85d035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:21.276118 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ed3f9-61c9-4594-a89e-2951fc85d035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:21.277556 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ed3f9-61c9-4594-a89e-2951fc85d035 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-808ed3f9-61c9-4594-a89e-2951fc85d035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:21.292202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:21.293158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:21.294050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:21.294050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:21.294050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:21.294050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:21.294050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:21.294050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:21.294050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:21.294050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:21.294050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 297/600] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:21.300982 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ed3f9-61c9-4594-a89e-2951fc85d035 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:21.350316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848f868-96bb-492e-9bef-b505b61b3a5a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:21.373096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:21.390374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c4eae-7a26-4663-936e-4baae7626a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:21.391169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c4eae-7a26-4663-936e-4baae7626a4f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:21.391446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c4eae-7a26-4663-936e-4baae7626a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:21.391709 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c4eae-7a26-4663-936e-4baae7626a4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:21.402324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c4eae-7a26-4663-936e-4baae7626a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:21.403769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c4eae-7a26-4663-936e-4baae7626a4f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a35c4eae-7a26-4663-936e-4baae7626a4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:21.421350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:21.422266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:21.423148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:21.423148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:21.423148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:21.423148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:21.427128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 304/601] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:21.427812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ed3f9-61c9-4594-a89e-2951fc85d035 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:21.428375 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c4eae-7a26-4663-936e-4baae7626a4f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:21.470192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d8a70-6043-448f-b762-a29cf3b1befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:21.471163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d8a70-6043-448f-b762-a29cf3b1befc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:21.471720 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d8a70-6043-448f-b762-a29cf3b1befc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:21.472001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d8a70-6043-448f-b762-a29cf3b1befc None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:21.472803 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d8a70-6043-448f-b762-a29cf3b1befc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:21.473303 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d8a70-6043-448f-b762-a29cf3b1befc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:21.475455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d8a70-6043-448f-b762-a29cf3b1befc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:21.487496 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:21.491895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 298/602] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:21.498650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d8a70-6043-448f-b762-a29cf3b1befc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:21.542120 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c4eae-7a26-4663-936e-4baae7626a4f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:21.584342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d340df-a093-48cb-8079-ee0be8ccc079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:21.585336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d340df-a093-48cb-8079-ee0be8ccc079 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:21.585626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d340df-a093-48cb-8079-ee0be8ccc079 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:21.585901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d340df-a093-48cb-8079-ee0be8ccc079 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:21.586921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d340df-a093-48cb-8079-ee0be8ccc079 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:21.587226 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d340df-a093-48cb-8079-ee0be8ccc079 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:21.589067 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d340df-a093-48cb-8079-ee0be8ccc079 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:21.605074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 305/603] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:21.606463 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145afc-d642-4834-865c-1391d7a1b43b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:21.606749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145afc-d642-4834-865c-1391d7a1b43b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:21.607028 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145afc-d642-4834-865c-1391d7a1b43b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:21.610008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 306/604] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:21.610790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55145afc-d642-4834-865c-1391d7a1b43b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:21.619853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d8a70-6043-448f-b762-a29cf3b1befc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:21.645625 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:21.663544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b7fb6-8a55-4c46-a3fa-3851b67e07b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:21.664451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b7fb6-8a55-4c46-a3fa-3851b67e07b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:21.664736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b7fb6-8a55-4c46-a3fa-3851b67e07b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:21.665059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b7fb6-8a55-4c46-a3fa-3851b67e07b2 None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/344585d4cf44449e8b040d635fe45c65/roles/b464352c183141f4a1be0d9764ea4105` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:21.680924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b7fb6-8a55-4c46-a3fa-3851b67e07b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=344585d4cf44449e8b040d635fe45c65, role_id=b464352c183141f4a1be0d9764ea4105)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:21.682647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b7fb6-8a55-4c46-a3fa-3851b67e07b2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:21.700406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 299/605] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:18:21 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/344585d4cf44449e8b040d635fe45c65/roles/b464352c183141f4a1be0d9764ea4105 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:18:21.701835 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5d38d-f59f-4289-b19e-00cb2e166f2a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:21.702131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5d38d-f59f-4289-b19e-00cb2e166f2a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:21.702412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5d38d-f59f-4289-b19e-00cb2e166f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:21.721702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-28e5d38d-f59f-4289-b19e-00cb2e166f2a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:21.722993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-28e5d38d-f59f-4289-b19e-00cb2e166f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:21.734161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55145afc-d642-4834-865c-1391d7a1b43b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:21.777528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:21.821251 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eb6f1-21e8-484f-a571-fb3986c58de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:21.823126 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eb6f1-21e8-484f-a571-fb3986c58de5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:21.823399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eb6f1-21e8-484f-a571-fb3986c58de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:21.823667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eb6f1-21e8-484f-a571-fb3986c58de5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:21.841437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eb6f1-21e8-484f-a571-fb3986c58de5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:21.845045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eb6f1-21e8-484f-a571-fb3986c58de5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5d6eb6f1-21e8-484f-a571-fb3986c58de5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:21.870378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:21.871457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:21.872329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:21.872329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:21.872329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:21.872329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:21.872329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:21.872329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:21.872329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:21.872329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:21.872329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 307/606] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:21.877882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eb6f1-21e8-484f-a571-fb3986c58de5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:21.892723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 300/607] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:21.917589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5d38d-f59f-4289-b19e-00cb2e166f2a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:22.010855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eb6f1-21e8-484f-a571-fb3986c58de5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:22.049959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270013d9-9056-4f2a-9acc-8afed8bcbddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:22.051037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270013d9-9056-4f2a-9acc-8afed8bcbddb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:22.051598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270013d9-9056-4f2a-9acc-8afed8bcbddb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:22.052019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270013d9-9056-4f2a-9acc-8afed8bcbddb None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:22.053301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270013d9-9056-4f2a-9acc-8afed8bcbddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:22.053749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270013d9-9056-4f2a-9acc-8afed8bcbddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:22.055360 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270013d9-9056-4f2a-9acc-8afed8bcbddb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:22.066376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:22.070108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 308/608] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:22.076604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270013d9-9056-4f2a-9acc-8afed8bcbddb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:22.086392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5d38d-f59f-4289-b19e-00cb2e166f2a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:22.119062 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:22.185678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13719929-1562-40b2-97ad-446c583a59df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:22.186683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13719929-1562-40b2-97ad-446c583a59df None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:22.186818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13719929-1562-40b2-97ad-446c583a59df None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:22.187025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13719929-1562-40b2-97ad-446c583a59df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:22.193010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270013d9-9056-4f2a-9acc-8afed8bcbddb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:22.225845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13719929-1562-40b2-97ad-446c583a59df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:22.230736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e5308-09b6-4a96-ad0f-d0d46707ed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:22.231902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e5308-09b6-4a96-ad0f-d0d46707ed62 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:22.232324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e5308-09b6-4a96-ad0f-d0d46707ed62 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:22.232740 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e5308-09b6-4a96-ad0f-d0d46707ed62 None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/1c5ad3094ee04495a6ab82c92d458aca/roles/b464352c183141f4a1be0d9764ea4105` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-13719929-1562-40b2-97ad-446c583a59df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:22.233500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:22.234604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:22.235692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 301/609] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:22.245944 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13719929-1562-40b2-97ad-446c583a59df None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:22.252526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e5308-09b6-4a96-ad0f-d0d46707ed62 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=1c5ad3094ee04495a6ab82c92d458aca, role_id=b464352c183141f4a1be0d9764ea4105)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:22.254185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e5308-09b6-4a96-ad0f-d0d46707ed62 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:22.275979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 309/610] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:18:22 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/1c5ad3094ee04495a6ab82c92d458aca/roles/b464352c183141f4a1be0d9764ea4105 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:18:22.369596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13719929-1562-40b2-97ad-446c583a59df None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:22.407590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3839-2af6-41ed-a7a3-9a5565d31ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:22.408548 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3839-2af6-41ed-a7a3-9a5565d31ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:22.409054 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3839-2af6-41ed-a7a3-9a5565d31ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:22.409477 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3839-2af6-41ed-a7a3-9a5565d31ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:22.410420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3839-2af6-41ed-a7a3-9a5565d31ce6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:22.410889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3839-2af6-41ed-a7a3-9a5565d31ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:22.412536 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3839-2af6-41ed-a7a3-9a5565d31ce6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:22.422449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 302/611] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:22.430177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e5308-09b6-4a96-ad0f-d0d46707ed62 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:22.531359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:22.560118 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e5308-09b6-4a96-ad0f-d0d46707ed62 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:22.605275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91586cde-3365-4604-a5e1-502c4c84ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:22.606399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91586cde-3365-4604-a5e1-502c4c84ea7b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:22.606850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91586cde-3365-4604-a5e1-502c4c84ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:22.607267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91586cde-3365-4604-a5e1-502c4c84ea7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:22.618565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91586cde-3365-4604-a5e1-502c4c84ea7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:22.620369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91586cde-3365-4604-a5e1-502c4c84ea7b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-91586cde-3365-4604-a5e1-502c4c84ea7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:22.639767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:22.640937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:22.642105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:22.642105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:22.642105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:22.642105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:22.643794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 310/612] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:22.652858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3839-2af6-41ed-a7a3-9a5565d31ce6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:22.675829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:22.764162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3839-2af6-41ed-a7a3-9a5565d31ce6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:22.802158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6f11d-ad8b-4489-abec-bedb682b13f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:22.805399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6f11d-ad8b-4489-abec-bedb682b13f2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:22.805399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6f11d-ad8b-4489-abec-bedb682b13f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:22.805399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6f11d-ad8b-4489-abec-bedb682b13f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:22.805399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6f11d-ad8b-4489-abec-bedb682b13f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:22.805399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6f11d-ad8b-4489-abec-bedb682b13f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:22.805890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6f11d-ad8b-4489-abec-bedb682b13f2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:22.826451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 303/613] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:22.834061 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91586cde-3365-4604-a5e1-502c4c84ea7b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:23.004718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91586cde-3365-4604-a5e1-502c4c84ea7b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:23.048109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3ea17-a90d-40e0-a2f0-cf8c86895a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:23.048922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ea17-a90d-40e0-a2f0-cf8c86895a41 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:23.049242 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ea17-a90d-40e0-a2f0-cf8c86895a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:23.049516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ea17-a90d-40e0-a2f0-cf8c86895a41 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:23.062091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3ea17-a90d-40e0-a2f0-cf8c86895a41 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:23.063551 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3ea17-a90d-40e0-a2f0-cf8c86895a41 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:23.065440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3fa3ea17-a90d-40e0-a2f0-cf8c86895a41 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:23.084899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:23.085913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:23.086828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:23.086828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:23.086828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:23.086828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:23.086828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:23.086828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:23.086828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:23.086828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:23.086828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:23.086828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:23.086828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 311/614] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:23.091984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6f11d-ad8b-4489-abec-bedb682b13f2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:23.201888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:23.228690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6f11d-ad8b-4489-abec-bedb682b13f2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:23.275250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535edb6c-0095-4385-b34d-0b7c89d9371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:23.275842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535edb6c-0095-4385-b34d-0b7c89d9371a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:23.276120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535edb6c-0095-4385-b34d-0b7c89d9371a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:23.276389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535edb6c-0095-4385-b34d-0b7c89d9371a None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:23.277260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535edb6c-0095-4385-b34d-0b7c89d9371a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:23.277563 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535edb6c-0095-4385-b34d-0b7c89d9371a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:23.278992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535edb6c-0095-4385-b34d-0b7c89d9371a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:23.306971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 304/615] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jul 6 20:18:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:23.312047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3ea17-a90d-40e0-a2f0-cf8c86895a41 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:23.477985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3ea17-a90d-40e0-a2f0-cf8c86895a41 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:23.506210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62e80a-3e51-4da9-bf4b-ffc83520b63a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:23.506546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62e80a-3e51-4da9-bf4b-ffc83520b63a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:23.507084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62e80a-3e51-4da9-bf4b-ffc83520b63a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:23.508710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 305/616] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:23.513774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffd2c9-3924-4bef-93ef-a1e853db02ce None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:23.514072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffd2c9-3924-4bef-93ef-a1e853db02ce None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:23.514341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffd2c9-3924-4bef-93ef-a1e853db02ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:23.515655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f961f59-e51d-407d-b811-cc008485592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:23.516690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f961f59-e51d-407d-b811-cc008485592c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:23.517164 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f961f59-e51d-407d-b811-cc008485592c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:23.517627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f961f59-e51d-407d-b811-cc008485592c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:23.533807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-dcffd2c9-3924-4bef-93ef-a1e853db02ce None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:23.535208 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dcffd2c9-3924-4bef-93ef-a1e853db02ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:23.535796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f961f59-e51d-407d-b811-cc008485592c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:23.537568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f961f59-e51d-407d-b811-cc008485592c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8f961f59-e51d-407d-b811-cc008485592c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:23.556614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:23.557580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:23.558478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:23.558478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:23.558478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:23.558478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:23.560398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 312/617] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:23.562223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe31b1f-3605-419a-855b-fde5b9a91f62 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:23.562650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe31b1f-3605-419a-855b-fde5b9a91f62 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:23.563068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe31b1f-3605-419a-855b-fde5b9a91f62 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:23.564735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 313/618] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:23.569474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe31b1f-3605-419a-855b-fde5b9a91f62 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:23.620192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 306/619] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:18:23.621712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029378aa-7a8d-415f-9f11-e8624c72b17e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:23.622147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029378aa-7a8d-415f-9f11-e8624c72b17e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:23.622354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:23.622749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029378aa-7a8d-415f-9f11-e8624c72b17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:23.650050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-029378aa-7a8d-415f-9f11-e8624c72b17e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:23.651699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-029378aa-7a8d-415f-9f11-e8624c72b17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:23.703681 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe31b1f-3605-419a-855b-fde5b9a91f62 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:23.723054 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:23.741062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 307/620] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:23.742755 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029378aa-7a8d-415f-9f11-e8624c72b17e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:23.748060 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e3dbd-b554-4e12-af37-696e9bcc6ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:23.748781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3dbd-b554-4e12-af37-696e9bcc6ddd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:23.749136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3dbd-b554-4e12-af37-696e9bcc6ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:23.749417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3dbd-b554-4e12-af37-696e9bcc6ddd None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:23.750146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e3dbd-b554-4e12-af37-696e9bcc6ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:23.750457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e3dbd-b554-4e12-af37-696e9bcc6ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:23.751968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e3dbd-b554-4e12-af37-696e9bcc6ddd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:23.766831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 314/621] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:23.772682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e3dbd-b554-4e12-af37-696e9bcc6ddd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:23.873833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029378aa-7a8d-415f-9f11-e8624c72b17e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:23.897907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e3dbd-b554-4e12-af37-696e9bcc6ddd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:23.910042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:23.911991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d9434-2c44-4188-ad11-f3bc28106a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:23.913079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d9434-2c44-4188-ad11-f3bc28106a23 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:23.913365 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d9434-2c44-4188-ad11-f3bc28106a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:23.913675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d9434-2c44-4188-ad11-f3bc28106a23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:23.924450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d9434-2c44-4188-ad11-f3bc28106a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-da1d9434-2c44-4188-ad11-f3bc28106a23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:23.932184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:23.933132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:23.933977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:23.938485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 308/622] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:23.939421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d9434-2c44-4188-ad11-f3bc28106a23 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:23.941782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588feca5-b4ee-4b42-bc2b-f45d3a206be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:23.942800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588feca5-b4ee-4b42-bc2b-f45d3a206be5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:23.943268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588feca5-b4ee-4b42-bc2b-f45d3a206be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:23.943742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588feca5-b4ee-4b42-bc2b-f45d3a206be5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:23.951209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588feca5-b4ee-4b42-bc2b-f45d3a206be5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:23.952899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588feca5-b4ee-4b42-bc2b-f45d3a206be5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-588feca5-b4ee-4b42-bc2b-f45d3a206be5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:23.967930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:23.969072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:23.970128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:23.970128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:23.970128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:23.970128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:23.970128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:23.970128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:23.970128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:23.970128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:23.972175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 315/623] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:23.973141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588feca5-b4ee-4b42-bc2b-f45d3a206be5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:24.004744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:24.051267 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d9434-2c44-4188-ad11-f3bc28106a23 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:24.078228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588feca5-b4ee-4b42-bc2b-f45d3a206be5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:24.086074 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5302a29-0eec-431a-bae8-caeb428f04d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:24.087075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5302a29-0eec-431a-bae8-caeb428f04d1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.087514 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5302a29-0eec-431a-bae8-caeb428f04d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.087939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5302a29-0eec-431a-bae8-caeb428f04d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.098913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5302a29-0eec-431a-bae8-caeb428f04d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e5302a29-0eec-431a-bae8-caeb428f04d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:24.106846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:24.107962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:24.109032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:24.111318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 309/624] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:24.112237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5302a29-0eec-431a-bae8-caeb428f04d1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:24.120135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b801b-95bc-474a-96e2-09ac5c546a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:24.120817 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b801b-95bc-474a-96e2-09ac5c546a58 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.121153 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b801b-95bc-474a-96e2-09ac5c546a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.121437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b801b-95bc-474a-96e2-09ac5c546a58 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.122205 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b801b-95bc-474a-96e2-09ac5c546a58 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:24.122556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b801b-95bc-474a-96e2-09ac5c546a58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:24.123985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b801b-95bc-474a-96e2-09ac5c546a58 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:24.137017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 316/625] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:24.137017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b801b-95bc-474a-96e2-09ac5c546a58 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:24.168423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:24.226143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5302a29-0eec-431a-bae8-caeb428f04d1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:24.238707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b801b-95bc-474a-96e2-09ac5c546a58 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:24.243254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:24.264476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bb6d9-a4ac-4933-9409-9a19f1da677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:24.265167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bb6d9-a4ac-4933-9409-9a19f1da677c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.265446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bb6d9-a4ac-4933-9409-9a19f1da677c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.265726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bb6d9-a4ac-4933-9409-9a19f1da677c None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.266514 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bb6d9-a4ac-4933-9409-9a19f1da677c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:24.266818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bb6d9-a4ac-4933-9409-9a19f1da677c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:24.268258 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bb6d9-a4ac-4933-9409-9a19f1da677c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:24.275043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed547b1e-74fe-4fb0-88c2-a2377324a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:24.276813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547b1e-74fe-4fb0-88c2-a2377324a530 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.277282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547b1e-74fe-4fb0-88c2-a2377324a530 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.277564 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547b1e-74fe-4fb0-88c2-a2377324a530 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.278766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed547b1e-74fe-4fb0-88c2-a2377324a530 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:24.279080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed547b1e-74fe-4fb0-88c2-a2377324a530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:24.280664 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed547b1e-74fe-4fb0-88c2-a2377324a530 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:24.282240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 310/626] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:24.283546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a1ec1-3393-4068-a1d0-c2cfe103f150 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.283899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a1ec1-3393-4068-a1d0-c2cfe103f150 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.284173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a1ec1-3393-4068-a1d0-c2cfe103f150 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.289276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 311/627] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:24.289890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a1ec1-3393-4068-a1d0-c2cfe103f150 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:24.297818 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 317/628] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:24.298941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed547b1e-74fe-4fb0-88c2-a2377324a530 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:24.393979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:24.401104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a1ec1-3393-4068-a1d0-c2cfe103f150 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:24.401840 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed547b1e-74fe-4fb0-88c2-a2377324a530 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:24.436644 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185d561-cc7c-4ed4-885b-9f17412a92a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:24.437485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185d561-cc7c-4ed4-885b-9f17412a92a0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.437770 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185d561-cc7c-4ed4-885b-9f17412a92a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.438045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185d561-cc7c-4ed4-885b-9f17412a92a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.440362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55983821-fc1d-4db3-b4b3-3db7d3b374d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:24.441517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983821-fc1d-4db3-b4b3-3db7d3b374d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.441938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983821-fc1d-4db3-b4b3-3db7d3b374d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.442348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983821-fc1d-4db3-b4b3-3db7d3b374d1 None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/b11e395dab424f3492f092eb3d5032dd/roles/b464352c183141f4a1be0d9764ea4105` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.448697 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185d561-cc7c-4ed4-885b-9f17412a92a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:24.450176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185d561-cc7c-4ed4-885b-9f17412a92a0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:24.458211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55983821-fc1d-4db3-b4b3-3db7d3b374d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=b11e395dab424f3492f092eb3d5032dd, role_id=b464352c183141f4a1be0d9764ea4105)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:24.459982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55983821-fc1d-4db3-b4b3-3db7d3b374d1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6185d561-cc7c-4ed4-885b-9f17412a92a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:24.468254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:24.469462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:24.470549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:24.470549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:24.470549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:24.470549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:24.474157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 312/629] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:24.475287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88e4d-64c4-496a-a14c-fcf3a4afa514 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.475575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88e4d-64c4-496a-a14c-fcf3a4afa514 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.475849 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88e4d-64c4-496a-a14c-fcf3a4afa514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.477861 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 318/630] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:18:24 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/b11e395dab424f3492f092eb3d5032dd/roles/b464352c183141f4a1be0d9764ea4105 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:18:24.478870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55983821-fc1d-4db3-b4b3-3db7d3b374d1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:24.505275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-80b88e4d-64c4-496a-a14c-fcf3a4afa514 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:24.506584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-80b88e4d-64c4-496a-a14c-fcf3a4afa514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:24.535214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:24.590869 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 313/631] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:24.592174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b88e4d-64c4-496a-a14c-fcf3a4afa514 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:24.618806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55983821-fc1d-4db3-b4b3-3db7d3b374d1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:24.658827 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070442a-a44e-4e72-933f-a9d1df51601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:24.659518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070442a-a44e-4e72-933f-a9d1df51601b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.659797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070442a-a44e-4e72-933f-a9d1df51601b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.660069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070442a-a44e-4e72-933f-a9d1df51601b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.672769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070442a-a44e-4e72-933f-a9d1df51601b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:24.674391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070442a-a44e-4e72-933f-a9d1df51601b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:24.678609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1070442a-a44e-4e72-933f-a9d1df51601b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:24.697714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:24.698687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:24.699576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:24.699576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:24.699576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:24.699576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:24.699576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 319/632] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:24.700306 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070442a-a44e-4e72-933f-a9d1df51601b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:24.716709 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b88e4d-64c4-496a-a14c-fcf3a4afa514 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:24.758219 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaa8aa-ace9-4c91-a50c-d6985efdefee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:24.758983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa8aa-ace9-4c91-a50c-d6985efdefee None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.759270 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa8aa-ace9-4c91-a50c-d6985efdefee None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.759541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa8aa-ace9-4c91-a50c-d6985efdefee None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.760277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaa8aa-ace9-4c91-a50c-d6985efdefee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:24.760583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaa8aa-ace9-4c91-a50c-d6985efdefee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:24.762054 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaa8aa-ace9-4c91-a50c-d6985efdefee None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:24.775112 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 314/633] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:24.780512 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaa8aa-ace9-4c91-a50c-d6985efdefee None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:24.798213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:24.816834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070442a-a44e-4e72-933f-a9d1df51601b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:24.853926 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14df26-9ef9-45de-a0ac-61f5082265e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:24.854730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14df26-9ef9-45de-a0ac-61f5082265e1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.855014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14df26-9ef9-45de-a0ac-61f5082265e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.855292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14df26-9ef9-45de-a0ac-61f5082265e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.867206 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14df26-9ef9-45de-a0ac-61f5082265e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8a14df26-9ef9-45de-a0ac-61f5082265e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:24.875530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:24.876637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:24.877683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:24.881432 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 320/634] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:24.883066 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c862562-9a9b-4872-95eb-c750f02b2581 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.883388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c862562-9a9b-4872-95eb-c750f02b2581 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.883655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c862562-9a9b-4872-95eb-c750f02b2581 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.884990 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 321/635] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:24.889133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c862562-9a9b-4872-95eb-c750f02b2581 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:24.889245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaa8aa-ace9-4c91-a50c-d6985efdefee None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:24.922966 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a17eba-5426-4491-935c-327fe044a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:24.923542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a17eba-5426-4491-935c-327fe044a67d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:24.923816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a17eba-5426-4491-935c-327fe044a67d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:24.924300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a17eba-5426-4491-935c-327fe044a67d None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:24.924808 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a17eba-5426-4491-935c-327fe044a67d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:24.925147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a17eba-5426-4491-935c-327fe044a67d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:24.926481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a17eba-5426-4491-935c-327fe044a67d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:24.940143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 315/636] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:24.941087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a17eba-5426-4491-935c-327fe044a67d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:24.956562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:25.014257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c862562-9a9b-4872-95eb-c750f02b2581 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:25.032673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:25.051213 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e9f79-47ae-4c3c-ba7c-1ce38726ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:25.052018 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9f79-47ae-4c3c-ba7c-1ce38726ea91 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:25.052301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9f79-47ae-4c3c-ba7c-1ce38726ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:25.052575 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9f79-47ae-4c3c-ba7c-1ce38726ea91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:25.058958 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a17eba-5426-4491-935c-327fe044a67d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:25.060421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e9f79-47ae-4c3c-ba7c-1ce38726ea91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:25.062307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e9f79-47ae-4c3c-ba7c-1ce38726ea91 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-235e9f79-47ae-4c3c-ba7c-1ce38726ea91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:25.076646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:25.077825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:25.078956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:25.078956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:25.078956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:25.078956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:25.078956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:25.078956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:25.078956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:25.078956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:25.078956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:25.078956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:25.078956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 322/637] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Jul 6 20:18:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:25.079665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697d77f-48e7-477c-942a-fe161d422aae None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:25.079665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697d77f-48e7-477c-942a-fe161d422aae None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:25.079665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697d77f-48e7-477c-942a-fe161d422aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:25.103430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5697d77f-48e7-477c-942a-fe161d422aae None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:25.104739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5697d77f-48e7-477c-942a-fe161d422aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:25.110882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af593e-21b8-4fb2-9a19-ad7a89ec2d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:25.111636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af593e-21b8-4fb2-9a19-ad7a89ec2d3c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:25.111993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af593e-21b8-4fb2-9a19-ad7a89ec2d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:25.112339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af593e-21b8-4fb2-9a19-ad7a89ec2d3c None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:25.113299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af593e-21b8-4fb2-9a19-ad7a89ec2d3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:25.113590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af593e-21b8-4fb2-9a19-ad7a89ec2d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:25.114952 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af593e-21b8-4fb2-9a19-ad7a89ec2d3c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:25.123794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 316/638] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:25.124391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af593e-21b8-4fb2-9a19-ad7a89ec2d3c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:25.191688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 323/639] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:25.193204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697d77f-48e7-477c-942a-fe161d422aae None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:25.226191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af593e-21b8-4fb2-9a19-ad7a89ec2d3c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:25.245648 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:25.263472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fa52a-258b-4143-a38a-38a289a36c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:25.264358 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa52a-258b-4143-a38a-38a289a36c96 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:25.264715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa52a-258b-4143-a38a-38a289a36c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:25.265087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa52a-258b-4143-a38a-38a289a36c96 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:25.272837 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fa52a-258b-4143-a38a-38a289a36c96 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:25.274431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fa52a-258b-4143-a38a-38a289a36c96 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:25.278111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-163fa52a-258b-4143-a38a-38a289a36c96 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:25.291693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:25.293741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:25.295048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:25.295048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:25.295048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:25.295048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:25.295048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:25.295048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:25.295048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:25.295048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:25.295048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:18:25.295048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:25.298063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 317/640] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:25.298777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fa52a-258b-4143-a38a-38a289a36c96 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:25.317155 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697d77f-48e7-477c-942a-fe161d422aae None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:25.354020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc8f18-140a-465f-9c8d-0955821d4406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:25.354690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc8f18-140a-465f-9c8d-0955821d4406 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:25.354959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc8f18-140a-465f-9c8d-0955821d4406 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:25.355230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc8f18-140a-465f-9c8d-0955821d4406 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:25.356064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc8f18-140a-465f-9c8d-0955821d4406 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:25.356363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc8f18-140a-465f-9c8d-0955821d4406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:25.357839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc8f18-140a-465f-9c8d-0955821d4406 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:25.379324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 324/641] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jul 6 20:18:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:25.379324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc8f18-140a-465f-9c8d-0955821d4406 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:25.412101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fa52a-258b-4143-a38a-38a289a36c96 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:25.447448 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32362f-63cd-4037-b014-305757cb3006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:25.448158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32362f-63cd-4037-b014-305757cb3006 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:25.448438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32362f-63cd-4037-b014-305757cb3006 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:25.448710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32362f-63cd-4037-b014-305757cb3006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:25.461189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32362f-63cd-4037-b014-305757cb3006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:25.462773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32362f-63cd-4037-b014-305757cb3006 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-cb32362f-63cd-4037-b014-305757cb3006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:25.480063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:25.481221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:25.482319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:25.482319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:25.482319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:25.482319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:25.488171 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 318/642] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:25.488171 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32362f-63cd-4037-b014-305757cb3006 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:25.488415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc8f18-140a-465f-9c8d-0955821d4406 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:25.488838 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:25.520822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a418f-6947-4c93-91d5-47ead69a4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:25.521653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a418f-6947-4c93-91d5-47ead69a4fac None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:25.521991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a418f-6947-4c93-91d5-47ead69a4fac None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:25.522264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a418f-6947-4c93-91d5-47ead69a4fac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:25.533975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a418f-6947-4c93-91d5-47ead69a4fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5e0a418f-6947-4c93-91d5-47ead69a4fac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:25.541764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:25.542715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 325/643] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:25.544329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a418f-6947-4c93-91d5-47ead69a4fac None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:25.548903 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:25.600717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32362f-63cd-4037-b014-305757cb3006 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:25.640428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3435-a6cf-4e5c-a172-5c180c923575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:25.641246 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3435-a6cf-4e5c-a172-5c180c923575 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:25.641530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3435-a6cf-4e5c-a172-5c180c923575 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:25.641793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3435-a6cf-4e5c-a172-5c180c923575 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:25.642654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be3435-a6cf-4e5c-a172-5c180c923575 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:25.642964 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be3435-a6cf-4e5c-a172-5c180c923575 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:25.644437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be3435-a6cf-4e5c-a172-5c180c923575 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:25.659321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a418f-6947-4c93-91d5-47ead69a4fac None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:25.663860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 319/644] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Jul 6 20:18:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:25.664523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3435-a6cf-4e5c-a172-5c180c923575 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:25.697555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714fa65-6bf3-49cf-804e-ccf6bf62d8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:25.698571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714fa65-6bf3-49cf-804e-ccf6bf62d8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:25.699222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714fa65-6bf3-49cf-804e-ccf6bf62d8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:25.699710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714fa65-6bf3-49cf-804e-ccf6bf62d8b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:25.732223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:25.764374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3435-a6cf-4e5c-a172-5c180c923575 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:25.771121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714fa65-6bf3-49cf-804e-ccf6bf62d8b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:25.772631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714fa65-6bf3-49cf-804e-ccf6bf62d8b0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:25.776653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:25.802618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8060-7542-4060-8a44-04b8fa592781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:25.803132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8060-7542-4060-8a44-04b8fa592781 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:25.803429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8060-7542-4060-8a44-04b8fa592781 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:25.803768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8060-7542-4060-8a44-04b8fa592781 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:25.804562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de8060-7542-4060-8a44-04b8fa592781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:25.804933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de8060-7542-4060-8a44-04b8fa592781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:25.806389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de8060-7542-4060-8a44-04b8fa592781 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:25.823653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 320/645] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:25.824689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8060-7542-4060-8a44-04b8fa592781 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:25.891297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 326/646] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:25.891297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714fa65-6bf3-49cf-804e-ccf6bf62d8b0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:25.937729 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8060-7542-4060-8a44-04b8fa592781 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:25.961000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:25.975318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80757a0-d112-47a6-b94a-5acac70e26bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:25.976101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80757a0-d112-47a6-b94a-5acac70e26bb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:25.976431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80757a0-d112-47a6-b94a-5acac70e26bb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:25.976784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80757a0-d112-47a6-b94a-5acac70e26bb None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:25.977639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80757a0-d112-47a6-b94a-5acac70e26bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:25.978033 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80757a0-d112-47a6-b94a-5acac70e26bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:25.979438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80757a0-d112-47a6-b94a-5acac70e26bb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:25.987953 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 321/647] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:25.988554 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80757a0-d112-47a6-b94a-5acac70e26bb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:26.004662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714fa65-6bf3-49cf-804e-ccf6bf62d8b0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:26.020545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:26.043908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57faa4-3437-4fff-8a8a-ce4f0de9407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:26.044649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57faa4-3437-4fff-8a8a-ce4f0de9407b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:26.045009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57faa4-3437-4fff-8a8a-ce4f0de9407b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:26.045340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57faa4-3437-4fff-8a8a-ce4f0de9407b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:26.096978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80757a0-d112-47a6-b94a-5acac70e26bb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:26.115443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57faa4-3437-4fff-8a8a-ce4f0de9407b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:26.116922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57faa4-3437-4fff-8a8a-ce4f0de9407b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:26.132555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2d253-ed41-4fb4-a03e-d1f3309f11af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:26.133387 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d253-ed41-4fb4-a03e-d1f3309f11af None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:26.133667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d253-ed41-4fb4-a03e-d1f3309f11af None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:26.133939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d253-ed41-4fb4-a03e-d1f3309f11af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:26.142102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2d253-ed41-4fb4-a03e-d1f3309f11af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:26.143751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2d253-ed41-4fb4-a03e-d1f3309f11af None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-26a2d253-ed41-4fb4-a03e-d1f3309f11af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:26.158407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:26.159401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:26.160334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:26.160334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:26.160334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:26.160334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:26.160334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:26.160334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:26.160334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:26.160334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:26.160334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:18:26.160334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:26.160334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 322/648] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:26.161599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2d253-ed41-4fb4-a03e-d1f3309f11af None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:26.188236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:26.233092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 327/649] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:26.233092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57faa4-3437-4fff-8a8a-ce4f0de9407b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:26.265400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:26.275614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2d253-ed41-4fb4-a03e-d1f3309f11af None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:26.311542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8668-4806-4fdb-94a3-0c169f8f59eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:26.312340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8668-4806-4fdb-94a3-0c169f8f59eb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:26.312629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8668-4806-4fdb-94a3-0c169f8f59eb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:26.312889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8668-4806-4fdb-94a3-0c169f8f59eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:26.324639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8668-4806-4fdb-94a3-0c169f8f59eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:26.326089 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8668-4806-4fdb-94a3-0c169f8f59eb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:26.333271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57faa4-3437-4fff-8a8a-ce4f0de9407b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0a1c8668-4806-4fdb-94a3-0c169f8f59eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:26.344479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:26.345586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:26.346485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:26.346485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:26.346485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:26.346485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:26.346485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 323/650] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:26.346485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8668-4806-4fdb-94a3-0c169f8f59eb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:26.372476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6af861-909b-41fc-b989-9ad55e51d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:26.373302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af861-909b-41fc-b989-9ad55e51d04a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:26.373579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af861-909b-41fc-b989-9ad55e51d04a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:26.374009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af861-909b-41fc-b989-9ad55e51d04a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:26.385287 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6af861-909b-41fc-b989-9ad55e51d04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:26.386763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6af861-909b-41fc-b989-9ad55e51d04a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9a6af861-909b-41fc-b989-9ad55e51d04a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:26.404250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:26.405207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:26.406093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:26.406093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:26.406093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:26.406093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:26.406093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 328/651] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:26.406363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6af861-909b-41fc-b989-9ad55e51d04a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:26.425188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:26.460448 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8668-4806-4fdb-94a3-0c169f8f59eb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:26.493402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428cc99-74d0-4e17-8fa9-5c16d8be5c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:26.493996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428cc99-74d0-4e17-8fa9-5c16d8be5c70 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:26.494278 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428cc99-74d0-4e17-8fa9-5c16d8be5c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:26.494547 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428cc99-74d0-4e17-8fa9-5c16d8be5c70 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:26.495389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428cc99-74d0-4e17-8fa9-5c16d8be5c70 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:26.495688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428cc99-74d0-4e17-8fa9-5c16d8be5c70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:26.497132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428cc99-74d0-4e17-8fa9-5c16d8be5c70 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:26.515028 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6af861-909b-41fc-b989-9ad55e51d04a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:26.516440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 324/652] 10.222.0.30 () {56 vars in 1137 bytes} [Wed Jul 6 20:18:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:26.517476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428cc99-74d0-4e17-8fa9-5c16d8be5c70 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:26.520332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:26.557411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618187-127b-495a-91d3-e42c0f5e2256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:26.558217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618187-127b-495a-91d3-e42c0f5e2256 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:26.558499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618187-127b-495a-91d3-e42c0f5e2256 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:26.558774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618187-127b-495a-91d3-e42c0f5e2256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:26.570382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59618187-127b-495a-91d3-e42c0f5e2256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:26.571867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59618187-127b-495a-91d3-e42c0f5e2256 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-59618187-127b-495a-91d3-e42c0f5e2256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:26.589466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:26.590555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:26.591445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:26.591445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:26.591445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:26.591445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:26.591445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 329/653] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:26.591445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618187-127b-495a-91d3-e42c0f5e2256 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:26.623358 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428cc99-74d0-4e17-8fa9-5c16d8be5c70 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:26.656096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e683-6c2d-49f8-81b2-ed93e47d5f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:26.656255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:26.656759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e683-6c2d-49f8-81b2-ed93e47d5f10 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:26.657068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e683-6c2d-49f8-81b2-ed93e47d5f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:26.657340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e683-6c2d-49f8-81b2-ed93e47d5f10 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:26.658065 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064e683-6c2d-49f8-81b2-ed93e47d5f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:26.658368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064e683-6c2d-49f8-81b2-ed93e47d5f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:26.659747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064e683-6c2d-49f8-81b2-ed93e47d5f10 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:26.670866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 325/654] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:26.671652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e683-6c2d-49f8-81b2-ed93e47d5f10 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:26.689394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618187-127b-495a-91d3-e42c0f5e2256 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:26.723694 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eda85f-b149-45f1-a417-9a6073f18a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:26.724385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eda85f-b149-45f1-a417-9a6073f18a9d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:26.724665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eda85f-b149-45f1-a417-9a6073f18a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:26.724996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eda85f-b149-45f1-a417-9a6073f18a9d None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:26.725712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eda85f-b149-45f1-a417-9a6073f18a9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:26.726035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eda85f-b149-45f1-a417-9a6073f18a9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:26.727396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eda85f-b149-45f1-a417-9a6073f18a9d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:26.731209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:26.739085 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 330/655] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:26.740312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d73576-dc35-4cb7-b7e5-df5d21cb9a1e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:26.740657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d73576-dc35-4cb7-b7e5-df5d21cb9a1e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:26.740936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d73576-dc35-4cb7-b7e5-df5d21cb9a1e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:26.742384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 331/656] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:26.742882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d73576-dc35-4cb7-b7e5-df5d21cb9a1e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:26.776216 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e683-6c2d-49f8-81b2-ed93e47d5f10 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:26.811695 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a7101-095b-4f0e-832c-6c5e668dbf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:26.812340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a7101-095b-4f0e-832c-6c5e668dbf5f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:26.812614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a7101-095b-4f0e-832c-6c5e668dbf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:26.812884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a7101-095b-4f0e-832c-6c5e668dbf5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:26.846113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d73576-dc35-4cb7-b7e5-df5d21cb9a1e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:26.871571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:26.880488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a75c3a-de40-4ae3-8b96-4d81d32ed7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:26.880715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a7101-095b-4f0e-832c-6c5e668dbf5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:26.881268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a75c3a-de40-4ae3-8b96-4d81d32ed7cd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:26.881547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a75c3a-de40-4ae3-8b96-4d81d32ed7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:26.882129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a75c3a-de40-4ae3-8b96-4d81d32ed7cd None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:26.882597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a7101-095b-4f0e-832c-6c5e668dbf5f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:26.882846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a75c3a-de40-4ae3-8b96-4d81d32ed7cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:26.883153 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a75c3a-de40-4ae3-8b96-4d81d32ed7cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:26.884499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a75c3a-de40-4ae3-8b96-4d81d32ed7cd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:26.896078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 332/657] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:26.896870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a75c3a-de40-4ae3-8b96-4d81d32ed7cd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:26.943868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:26.982082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 326/658] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:26.982896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a7101-095b-4f0e-832c-6c5e668dbf5f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:26.999098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a75c3a-de40-4ae3-8b96-4d81d32ed7cd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.033391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd182d14-4ff0-4a6a-8270-ad72aafc0f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.034120 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd182d14-4ff0-4a6a-8270-ad72aafc0f72 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.034400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd182d14-4ff0-4a6a-8270-ad72aafc0f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.034678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd182d14-4ff0-4a6a-8270-ad72aafc0f72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.041571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd182d14-4ff0-4a6a-8270-ad72aafc0f72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:27.042996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd182d14-4ff0-4a6a-8270-ad72aafc0f72 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bd182d14-4ff0-4a6a-8270-ad72aafc0f72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:27.056660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:27.057675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:27.058781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:27.058781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:27.058781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:27.058781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:27.058781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:27.058781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:27.058781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:27.058781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:27.058781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 333/659] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:27.060808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315597a-3821-4a22-862e-e7953ff0eb31 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.061125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315597a-3821-4a22-862e-e7953ff0eb31 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.061399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315597a-3821-4a22-862e-e7953ff0eb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.077371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5315597a-3821-4a22-862e-e7953ff0eb31 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:27.078533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5315597a-3821-4a22-862e-e7953ff0eb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:27.079516 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a7101-095b-4f0e-832c-6c5e668dbf5f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.112192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5290d-9732-40dc-9e4a-b53a2bb08877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.113019 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5290d-9732-40dc-9e4a-b53a2bb08877 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.113305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5290d-9732-40dc-9e4a-b53a2bb08877 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.113575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5290d-9732-40dc-9e4a-b53a2bb08877 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.120789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:27.120941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5290d-9732-40dc-9e4a-b53a2bb08877 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:27.122411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5290d-9732-40dc-9e4a-b53a2bb08877 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-66c5290d-9732-40dc-9e4a-b53a2bb08877 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:27.137787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:27.138727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:27.139639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:27.139639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:27.139639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:27.139639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:27.139639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:27.139639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:27.139639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:27.139639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:27.139639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:18:27.139639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:27.139639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 327/660] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:27.140242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5290d-9732-40dc-9e4a-b53a2bb08877 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:27.151249 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 334/661] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:27.152556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315597a-3821-4a22-862e-e7953ff0eb31 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:27.166018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:27.240036 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5290d-9732-40dc-9e4a-b53a2bb08877 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.253854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315597a-3821-4a22-862e-e7953ff0eb31 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.274132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b80126-b16c-4f25-8f13-94ad804c7fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.274904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b80126-b16c-4f25-8f13-94ad804c7fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.275179 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b80126-b16c-4f25-8f13-94ad804c7fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.275445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b80126-b16c-4f25-8f13-94ad804c7fb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.282130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b80126-b16c-4f25-8f13-94ad804c7fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:27.283613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b80126-b16c-4f25-8f13-94ad804c7fb8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:27.287142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f62c-1788-4d22-8189-d1f01a34ba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.287973 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f62c-1788-4d22-8189-d1f01a34ba70 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.288255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f62c-1788-4d22-8189-d1f01a34ba70 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.288529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f62c-1788-4d22-8189-d1f01a34ba70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-07b80126-b16c-4f25-8f13-94ad804c7fb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:27.297024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:27.297919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:27.298870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:27.298870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:27.298870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:27.298870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:27.298870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:27.298870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:27.298870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:27.298870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:27.298870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 328/662] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:27.299345 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f62c-1788-4d22-8189-d1f01a34ba70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:27.299421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b80126-b16c-4f25-8f13-94ad804c7fb8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:27.299909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f62c-1788-4d22-8189-d1f01a34ba70 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9003f62c-1788-4d22-8189-d1f01a34ba70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:27.319630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:27.320714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:27.326518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:27.326518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:27.326518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:27.326518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:27.326518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 335/663] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:27.326518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f62c-1788-4d22-8189-d1f01a34ba70 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:27.352709 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:27.377326 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:27.396001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b80126-b16c-4f25-8f13-94ad804c7fb8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.420941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f62c-1788-4d22-8189-d1f01a34ba70 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.429068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f675c1b-bf4a-4594-8a04-f55f6e9dbe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.429720 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675c1b-bf4a-4594-8a04-f55f6e9dbe76 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.430017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675c1b-bf4a-4594-8a04-f55f6e9dbe76 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.430286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675c1b-bf4a-4594-8a04-f55f6e9dbe76 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.431068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f675c1b-bf4a-4594-8a04-f55f6e9dbe76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:27.431368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f675c1b-bf4a-4594-8a04-f55f6e9dbe76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:27.432842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f675c1b-bf4a-4594-8a04-f55f6e9dbe76 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:27.444348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 329/664] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:27.445154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f675c1b-bf4a-4594-8a04-f55f6e9dbe76 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:27.459467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81208a1-d78d-402b-b1e8-9a73c36e72fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.460169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81208a1-d78d-402b-b1e8-9a73c36e72fb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.460447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81208a1-d78d-402b-b1e8-9a73c36e72fb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.460715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81208a1-d78d-402b-b1e8-9a73c36e72fb None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.461589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81208a1-d78d-402b-b1e8-9a73c36e72fb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:27.461892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81208a1-d78d-402b-b1e8-9a73c36e72fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:27.463324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81208a1-d78d-402b-b1e8-9a73c36e72fb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:27.480310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 336/665] 10.222.0.30 () {56 vars in 1139 bytes} [Wed Jul 6 20:18:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:27.481125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81208a1-d78d-402b-b1e8-9a73c36e72fb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:27.543633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f675c1b-bf4a-4594-8a04-f55f6e9dbe76 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.566167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:27.576801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37981bb0-99ef-49db-881a-95229352d254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.577619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37981bb0-99ef-49db-881a-95229352d254 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.577896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37981bb0-99ef-49db-881a-95229352d254 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.578159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37981bb0-99ef-49db-881a-95229352d254 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.579523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81208a1-d78d-402b-b1e8-9a73c36e72fb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.587867 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37981bb0-99ef-49db-881a-95229352d254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-37981bb0-99ef-49db-881a-95229352d254 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:27.595438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:27.596352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:27.597212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 330/666] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:27.597904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37981bb0-99ef-49db-881a-95229352d254 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:27.600102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:27.618750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f9dda-a3a6-4da5-baa6-a0c5224db44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.619407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f9dda-a3a6-4da5-baa6-a0c5224db44b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.619685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f9dda-a3a6-4da5-baa6-a0c5224db44b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.619954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f9dda-a3a6-4da5-baa6-a0c5224db44b None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.620734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f9dda-a3a6-4da5-baa6-a0c5224db44b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:27.621075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f9dda-a3a6-4da5-baa6-a0c5224db44b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:27.622504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f9dda-a3a6-4da5-baa6-a0c5224db44b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:27.634280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 337/667] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:27.635049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f9dda-a3a6-4da5-baa6-a0c5224db44b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:27.705253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37981bb0-99ef-49db-881a-95229352d254 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.740282 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf107856-cec1-467c-8d6e-6e35082b84dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.740950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf107856-cec1-467c-8d6e-6e35082b84dc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.741260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf107856-cec1-467c-8d6e-6e35082b84dc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.741632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf107856-cec1-467c-8d6e-6e35082b84dc None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.742537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf107856-cec1-467c-8d6e-6e35082b84dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:27.742769 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf107856-cec1-467c-8d6e-6e35082b84dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:27.744154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf107856-cec1-467c-8d6e-6e35082b84dc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:27.745303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f9dda-a3a6-4da5-baa6-a0c5224db44b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.762532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 331/668] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:27.762532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf107856-cec1-467c-8d6e-6e35082b84dc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:27.785317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd4c5d-6822-400b-8c1f-d6d8c36bc4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.785981 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd4c5d-6822-400b-8c1f-d6d8c36bc4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.786261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd4c5d-6822-400b-8c1f-d6d8c36bc4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.786540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd4c5d-6822-400b-8c1f-d6d8c36bc4b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.787469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd4c5d-6822-400b-8c1f-d6d8c36bc4b9 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=56ad461f6dc54014a956e5c8a094352c) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:27.787783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd4c5d-6822-400b-8c1f-d6d8c36bc4b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:27.789243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd4c5d-6822-400b-8c1f-d6d8c36bc4b9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:27.795101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 338/669] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:27 2022] GET /identity/v3/role_assignments?user.id=56ad461f6dc54014a956e5c8a094352c&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:27.795829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd4c5d-6822-400b-8c1f-d6d8c36bc4b9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:27.812243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:27.832922 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:27.883038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf107856-cec1-467c-8d6e-6e35082b84dc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.918403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd4c5d-6822-400b-8c1f-d6d8c36bc4b9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:27.927285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f3040-be47-45cf-86e6-9cd41432e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.928121 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f3040-be47-45cf-86e6-9cd41432e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.928512 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f3040-be47-45cf-86e6-9cd41432e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.928851 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f3040-be47-45cf-86e6-9cd41432e4a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.971991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53665502-da6f-405c-82dc-4b3e506ba09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:27.972935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53665502-da6f-405c-82dc-4b3e506ba09c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:27.973244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53665502-da6f-405c-82dc-4b3e506ba09c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:27.973518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53665502-da6f-405c-82dc-4b3e506ba09c None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:27.974297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53665502-da6f-405c-82dc-4b3e506ba09c None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:27.974609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53665502-da6f-405c-82dc-4b3e506ba09c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:27.976277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53665502-da6f-405c-82dc-4b3e506ba09c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:27.987502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 339/670] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:27.988424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53665502-da6f-405c-82dc-4b3e506ba09c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:28.040780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f3040-be47-45cf-86e6-9cd41432e4a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:28.042728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f3040-be47-45cf-86e6-9cd41432e4a5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:28.087803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:28.117238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53665502-da6f-405c-82dc-4b3e506ba09c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:28.120247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:28.154096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed4ec8-e9da-4276-bad5-3a407eb57268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:28.154755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed4ec8-e9da-4276-bad5-3a407eb57268 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:28.155035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed4ec8-e9da-4276-bad5-3a407eb57268 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:28.155310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed4ec8-e9da-4276-bad5-3a407eb57268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:28.156143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed4ec8-e9da-4276-bad5-3a407eb57268 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=16f53619b6994ae0a117549a67fa29a6) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:28.156453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed4ec8-e9da-4276-bad5-3a407eb57268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:28.157909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed4ec8-e9da-4276-bad5-3a407eb57268 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:28.161370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 332/671] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:28.162405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f3040-be47-45cf-86e6-9cd41432e4a5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:28.168246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 340/672] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:27 2022] GET /identity/v3/role_assignments?user.id=16f53619b6994ae0a117549a67fa29a6&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:28.169072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed4ec8-e9da-4276-bad5-3a407eb57268 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:28.280234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f3040-be47-45cf-86e6-9cd41432e4a5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:28.306685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed4ec8-e9da-4276-bad5-3a407eb57268 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:28.320816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb06d6-aa14-468d-bde9-04c25e2466ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:28.321817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb06d6-aa14-468d-bde9-04c25e2466ed None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:28.322310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb06d6-aa14-468d-bde9-04c25e2466ed None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:28.322697 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb06d6-aa14-468d-bde9-04c25e2466ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:28.330667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb06d6-aa14-468d-bde9-04c25e2466ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:28.332173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb06d6-aa14-468d-bde9-04c25e2466ed None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-57bb06d6-aa14-468d-bde9-04c25e2466ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:28.348844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:28.349959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:28.350848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:28.350848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:28.350848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:28.350848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:28.350848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:28.350848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:28.350848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:28.350848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:28.354782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 333/673] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:28.355943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb06d6-aa14-468d-bde9-04c25e2466ed None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:28.357771 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124feaa7-0a72-4086-8617-42b270e03cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:28.358574 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124feaa7-0a72-4086-8617-42b270e03cdd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:28.359064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124feaa7-0a72-4086-8617-42b270e03cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:28.359469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124feaa7-0a72-4086-8617-42b270e03cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:28.372363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:28.375985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124feaa7-0a72-4086-8617-42b270e03cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:28.378011 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124feaa7-0a72-4086-8617-42b270e03cdd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:28.386504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-124feaa7-0a72-4086-8617-42b270e03cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:28.400492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:28.401503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:28.402390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:28.402390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:28.402390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:28.402390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:28.404733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 341/674] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:28.405810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124feaa7-0a72-4086-8617-42b270e03cdd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:28.483413 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb06d6-aa14-468d-bde9-04c25e2466ed None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:28.518806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b242fb-d606-4f1c-9932-021399eff262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:28.519591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b242fb-d606-4f1c-9932-021399eff262 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:28.519875 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b242fb-d606-4f1c-9932-021399eff262 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:28.520154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b242fb-d606-4f1c-9932-021399eff262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:28.525292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124feaa7-0a72-4086-8617-42b270e03cdd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:28.531392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b242fb-d606-4f1c-9932-021399eff262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:28.532974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b242fb-d606-4f1c-9932-021399eff262 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-07b242fb-d606-4f1c-9932-021399eff262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:28.550528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:28.551464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:28.552331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:28.552331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:28.552331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:28.552331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:28.556364 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 334/675] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:28.557220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b242fb-d606-4f1c-9932-021399eff262 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:28.565434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fe0df-6deb-45c1-9d92-0472d89edc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:28.566483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fe0df-6deb-45c1-9d92-0472d89edc57 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:28.567053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fe0df-6deb-45c1-9d92-0472d89edc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:28.567513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fe0df-6deb-45c1-9d92-0472d89edc57 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:28.568748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fe0df-6deb-45c1-9d92-0472d89edc57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:28.569300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fe0df-6deb-45c1-9d92-0472d89edc57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:28.571031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fe0df-6deb-45c1-9d92-0472d89edc57 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:28.585140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 342/676] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:28.586280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fe0df-6deb-45c1-9d92-0472d89edc57 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:28.644255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:28.646234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:28.677415 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b242fb-d606-4f1c-9932-021399eff262 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:28.711894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fe0df-6deb-45c1-9d92-0472d89edc57 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:28.723428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2da45a-10d2-4258-9039-8a28714b604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:28.724095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2da45a-10d2-4258-9039-8a28714b604d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:28.724370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2da45a-10d2-4258-9039-8a28714b604d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:28.724641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2da45a-10d2-4258-9039-8a28714b604d None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:28.727286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2da45a-10d2-4258-9039-8a28714b604d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:28.727466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2da45a-10d2-4258-9039-8a28714b604d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:28.729994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2da45a-10d2-4258-9039-8a28714b604d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:28.746435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 335/677] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:28.747643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2da45a-10d2-4258-9039-8a28714b604d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:28.761316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ca4ec-1924-4016-a18e-a7925fe39c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:28.762639 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca4ec-1924-4016-a18e-a7925fe39c2c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:28.762639 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca4ec-1924-4016-a18e-a7925fe39c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:28.762892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca4ec-1924-4016-a18e-a7925fe39c2c None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:28.763601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ca4ec-1924-4016-a18e-a7925fe39c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:28.763906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ca4ec-1924-4016-a18e-a7925fe39c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:28.765398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ca4ec-1924-4016-a18e-a7925fe39c2c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:28.779617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 343/678] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:28.780498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ca4ec-1924-4016-a18e-a7925fe39c2c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:28.865899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2da45a-10d2-4258-9039-8a28714b604d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:28.900229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ca4ec-1924-4016-a18e-a7925fe39c2c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:28.908694 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4382eab-6423-4078-82e0-db6ceebb7808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:28.910059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382eab-6423-4078-82e0-db6ceebb7808 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:28.910520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382eab-6423-4078-82e0-db6ceebb7808 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:28.911420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:28.911746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382eab-6423-4078-82e0-db6ceebb7808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:28.913475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4382eab-6423-4078-82e0-db6ceebb7808 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=344585d4cf44449e8b040d635fe45c65) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:28.913940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4382eab-6423-4078-82e0-db6ceebb7808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:28.916422 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4382eab-6423-4078-82e0-db6ceebb7808 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:28.918910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:28.924942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 336/679] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:28 2022] GET /identity/v3/role_assignments?user.id=344585d4cf44449e8b040d635fe45c65&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:28.926530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4382eab-6423-4078-82e0-db6ceebb7808 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:28.942347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2966c9-0cac-4968-873e-9c742dd9b03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:28.943209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2966c9-0cac-4968-873e-9c742dd9b03c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:28.943544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2966c9-0cac-4968-873e-9c742dd9b03c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:28.943821 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2966c9-0cac-4968-873e-9c742dd9b03c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:28.953073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2966c9-0cac-4968-873e-9c742dd9b03c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:28.954672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2966c9-0cac-4968-873e-9c742dd9b03c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8d2966c9-0cac-4968-873e-9c742dd9b03c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:28.971757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:28.972775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:28.973752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:28.973752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:28.973752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:28.973752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:28.973752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:28.973752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:28.973752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:28.973752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:28.973752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:28.973752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:28.973752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 344/680] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:28.979208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2966c9-0cac-4968-873e-9c742dd9b03c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:29.107253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4382eab-6423-4078-82e0-db6ceebb7808 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:29.155500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2966c9-0cac-4968-873e-9c742dd9b03c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:29.181221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd26e6-5fc0-43cd-b494-0cdc33b181e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:29.182512 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd26e6-5fc0-43cd-b494-0cdc33b181e8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:29.183167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd26e6-5fc0-43cd-b494-0cdc33b181e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:29.183684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd26e6-5fc0-43cd-b494-0cdc33b181e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:29.192994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd26e6-5fc0-43cd-b494-0cdc33b181e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:29.194995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd26e6-5fc0-43cd-b494-0cdc33b181e8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:29.206916 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd2a57-4861-45eb-a927-e910c63a3b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:29.207687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd2a57-4861-45eb-a927-e910c63a3b4c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:29.208029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd2a57-4861-45eb-a927-e910c63a3b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:29.208369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd2a57-4861-45eb-a927-e910c63a3b4c None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:29.209397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd2a57-4861-45eb-a927-e910c63a3b4c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:29.209765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd2a57-4861-45eb-a927-e910c63a3b4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:29.211313 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd2a57-4861-45eb-a927-e910c63a3b4c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-56cd26e6-5fc0-43cd-b494-0cdc33b181e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:29.215518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:29.216461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:29.217628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:29.217628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:29.217628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:29.217628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:29.217628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:29.217628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:29.217628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:29.217628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:29.219809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 337/681] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:29.225569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd26e6-5fc0-43cd-b494-0cdc33b181e8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:29.235289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 345/682] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jul 6 20:18:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:29.240721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd2a57-4861-45eb-a927-e910c63a3b4c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:29.273091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:29.306264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:29.358610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd26e6-5fc0-43cd-b494-0cdc33b181e8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:29.364844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd2a57-4861-45eb-a927-e910c63a3b4c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:29.404099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd44828-15a5-4da5-b890-cd0d9c00e8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:29.404996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd44828-15a5-4da5-b890-cd0d9c00e8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:29.405483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd44828-15a5-4da5-b890-cd0d9c00e8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:29.405830 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd44828-15a5-4da5-b890-cd0d9c00e8f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:29.410485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b26e01-05d1-49e1-a1cc-736931c8dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:29.411444 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b26e01-05d1-49e1-a1cc-736931c8dbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:29.411946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b26e01-05d1-49e1-a1cc-736931c8dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:29.412453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b26e01-05d1-49e1-a1cc-736931c8dbe3 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:29.413495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b26e01-05d1-49e1-a1cc-736931c8dbe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:29.414001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b26e01-05d1-49e1-a1cc-736931c8dbe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:29.416188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b26e01-05d1-49e1-a1cc-736931c8dbe3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:29.433718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 338/683] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:29.439291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b26e01-05d1-49e1-a1cc-736931c8dbe3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:29.539303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd44828-15a5-4da5-b890-cd0d9c00e8f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:29.540795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd44828-15a5-4da5-b890-cd0d9c00e8f9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:29.556878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b26e01-05d1-49e1-a1cc-736931c8dbe3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:29.577479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:29.597994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229d9f8-e6b1-48d0-877d-41aa374eea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:29.599241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229d9f8-e6b1-48d0-877d-41aa374eea97 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:29.600011 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229d9f8-e6b1-48d0-877d-41aa374eea97 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:29.600480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229d9f8-e6b1-48d0-877d-41aa374eea97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:29.601541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229d9f8-e6b1-48d0-877d-41aa374eea97 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=1c5ad3094ee04495a6ab82c92d458aca) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:29.602095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229d9f8-e6b1-48d0-877d-41aa374eea97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:29.603730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229d9f8-e6b1-48d0-877d-41aa374eea97 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:29.611472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 339/684] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:29 2022] GET /identity/v3/role_assignments?user.id=1c5ad3094ee04495a6ab82c92d458aca&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:29.612748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:29.738330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 346/685] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:18:29.743866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229d9f8-e6b1-48d0-877d-41aa374eea97 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:29.882642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229d9f8-e6b1-48d0-877d-41aa374eea97 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:29.918245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff9d57-c285-41ee-8319-e12c5c336f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:29.919053 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff9d57-c285-41ee-8319-e12c5c336f58 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:29.919332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff9d57-c285-41ee-8319-e12c5c336f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:29.919604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff9d57-c285-41ee-8319-e12c5c336f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:29.930858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff9d57-c285-41ee-8319-e12c5c336f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:29.932390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff9d57-c285-41ee-8319-e12c5c336f58 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:29.947248 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04f71-79f1-472d-ad23-ceb3a4a03f9f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:29.948215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04f71-79f1-472d-ad23-ceb3a4a03f9f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:29.948683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04f71-79f1-472d-ad23-ceb3a4a03f9f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:29.950809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 347/686] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-44ff9d57-c285-41ee-8319-e12c5c336f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:29.952986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:29.953888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:29.954776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:29.954776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:29.954776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:29.954776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:29.954776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 340/687] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:29.958415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19380c-0b11-427a-8992-ffa9e83b67dc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:29.958618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff9d57-c285-41ee-8319-e12c5c336f58 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:29.959129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19380c-0b11-427a-8992-ffa9e83b67dc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:29.959594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19380c-0b11-427a-8992-ffa9e83b67dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:29.980544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cd19380c-0b11-427a-8992-ffa9e83b67dc None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:29.982145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cd19380c-0b11-427a-8992-ffa9e83b67dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:29.996916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:30.080266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 348/688] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:30.086967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff9d57-c285-41ee-8319-e12c5c336f58 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:30.133080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056ec12-33b1-453f-afd2-a620b14d9340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:30.133762 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056ec12-33b1-453f-afd2-a620b14d9340 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:30.134105 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056ec12-33b1-453f-afd2-a620b14d9340 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:30.134386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056ec12-33b1-453f-afd2-a620b14d9340 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:30.135175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056ec12-33b1-453f-afd2-a620b14d9340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:30.135489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056ec12-33b1-453f-afd2-a620b14d9340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:30.136872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056ec12-33b1-453f-afd2-a620b14d9340 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:30.142006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19380c-0b11-427a-8992-ffa9e83b67dc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:30.164277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 341/689] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:30.168382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056ec12-33b1-453f-afd2-a620b14d9340 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:30.250831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:30.298276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:30.306029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056ec12-33b1-453f-afd2-a620b14d9340 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:30.342786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f641e-2a6c-4fcf-8811-717b5414ab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:30.343594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f641e-2a6c-4fcf-8811-717b5414ab5b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:30.344397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f641e-2a6c-4fcf-8811-717b5414ab5b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:30.344672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f641e-2a6c-4fcf-8811-717b5414ab5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:30.351731 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f641e-2a6c-4fcf-8811-717b5414ab5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:30.353377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f641e-2a6c-4fcf-8811-717b5414ab5b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-724f641e-2a6c-4fcf-8811-717b5414ab5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:30.375995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:30.376926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:30.377838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:30.377838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:30.377838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:30.377838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:30.377838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:30.377838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:30.377838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:30.377838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:30.379799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 342/690] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:30.384499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f641e-2a6c-4fcf-8811-717b5414ab5b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:30.387233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19380c-0b11-427a-8992-ffa9e83b67dc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:30.458479 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221a99-96b6-4358-8659-f1b2d5f35a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:30.459387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221a99-96b6-4358-8659-f1b2d5f35a81 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:30.459673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221a99-96b6-4358-8659-f1b2d5f35a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:30.459948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221a99-96b6-4358-8659-f1b2d5f35a81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:30.478606 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af221a99-96b6-4358-8659-f1b2d5f35a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-af221a99-96b6-4358-8659-f1b2d5f35a81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:30.486322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:30.488376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:30.490472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:30.495455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 349/691] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:30.501372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221a99-96b6-4358-8659-f1b2d5f35a81 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:30.566051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f641e-2a6c-4fcf-8811-717b5414ab5b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:30.605134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ee89d-b07d-4fa7-8ddf-5c3efedbab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:30.605816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ee89d-b07d-4fa7-8ddf-5c3efedbab66 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:30.606100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ee89d-b07d-4fa7-8ddf-5c3efedbab66 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:30.606376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ee89d-b07d-4fa7-8ddf-5c3efedbab66 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:30.607178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ee89d-b07d-4fa7-8ddf-5c3efedbab66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:30.607490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ee89d-b07d-4fa7-8ddf-5c3efedbab66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:30.609414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ee89d-b07d-4fa7-8ddf-5c3efedbab66 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:30.629132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 343/692] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:30.630685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac4df4-5156-4137-b2c6-92db8053a8d9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:30.631053 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac4df4-5156-4137-b2c6-92db8053a8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:30.632483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac4df4-5156-4137-b2c6-92db8053a8d9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:30.634110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 344/693] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:30.634993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac4df4-5156-4137-b2c6-92db8053a8d9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:30.648000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221a99-96b6-4358-8659-f1b2d5f35a81 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:30.654581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:30.674536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:30.700269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b96c5-be17-44d3-81be-d3eb1b03cb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:30.701200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b96c5-be17-44d3-81be-d3eb1b03cb79 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:30.701875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b96c5-be17-44d3-81be-d3eb1b03cb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:30.702147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b96c5-be17-44d3-81be-d3eb1b03cb79 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:30.703165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b96c5-be17-44d3-81be-d3eb1b03cb79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:30.703469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b96c5-be17-44d3-81be-d3eb1b03cb79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:30.705635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b96c5-be17-44d3-81be-d3eb1b03cb79 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:30.717380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 350/694] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:30.718612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37a7d9-940b-499b-82e5-5c1c5558d1bd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:30.718892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37a7d9-940b-499b-82e5-5c1c5558d1bd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:30.719164 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37a7d9-940b-499b-82e5-5c1c5558d1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:30.743772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7e37a7d9-940b-499b-82e5-5c1c5558d1bd None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:30.745970 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7e37a7d9-940b-499b-82e5-5c1c5558d1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:30.751101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac4df4-5156-4137-b2c6-92db8053a8d9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:30.793574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c03553-a7b7-4e66-927d-c605738ed314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:30.794393 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03553-a7b7-4e66-927d-c605738ed314 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:30.795526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03553-a7b7-4e66-927d-c605738ed314 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:30.795801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03553-a7b7-4e66-927d-c605738ed314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:30.796641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c03553-a7b7-4e66-927d-c605738ed314 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=b11e395dab424f3492f092eb3d5032dd) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:30.796950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c03553-a7b7-4e66-927d-c605738ed314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:30.798398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c03553-a7b7-4e66-927d-c605738ed314 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:30.805371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 345/695] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:30 2022] GET /identity/v3/role_assignments?user.id=b11e395dab424f3492f092eb3d5032dd&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:30.806214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c03553-a7b7-4e66-927d-c605738ed314 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:30.841084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 351/696] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:30.877236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37a7d9-940b-499b-82e5-5c1c5558d1bd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:30.909363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:30.925886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c03553-a7b7-4e66-927d-c605738ed314 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:30.963111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a930878-09f3-4f91-8063-d69083f06d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:30.963933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930878-09f3-4f91-8063-d69083f06d7f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:30.964208 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930878-09f3-4f91-8063-d69083f06d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:30.964480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930878-09f3-4f91-8063-d69083f06d7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:30.976949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a930878-09f3-4f91-8063-d69083f06d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:30.978604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a930878-09f3-4f91-8063-d69083f06d7f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6a930878-09f3-4f91-8063-d69083f06d7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:30.999295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:31.000277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:31.001442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:31.001442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:31.001442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:31.001442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:31.001442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 346/697] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:31.007032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a930878-09f3-4f91-8063-d69083f06d7f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:31.074705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37a7d9-940b-499b-82e5-5c1c5558d1bd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:31.087766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:31.119980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e657032-843a-482d-adcf-9564516c0087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:31.121073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e657032-843a-482d-adcf-9564516c0087 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:31.121492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e657032-843a-482d-adcf-9564516c0087 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:31.121861 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e657032-843a-482d-adcf-9564516c0087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:31.134088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e657032-843a-482d-adcf-9564516c0087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:31.135789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e657032-843a-482d-adcf-9564516c0087 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:31.139213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a930878-09f3-4f91-8063-d69083f06d7f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2e657032-843a-482d-adcf-9564516c0087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:31.155071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:31.156054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:31.156948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:31.156948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:31.156948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:31.156948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:31.161346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 352/698] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:31.163622 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e657032-843a-482d-adcf-9564516c0087 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:31.174131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:31.186457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c5415-8bdd-45b5-83b0-e6a162c2f871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:31.187150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5415-8bdd-45b5-83b0-e6a162c2f871 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:31.187679 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5415-8bdd-45b5-83b0-e6a162c2f871 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:31.187978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5415-8bdd-45b5-83b0-e6a162c2f871 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:31.188685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c5415-8bdd-45b5-83b0-e6a162c2f871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:31.189012 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c5415-8bdd-45b5-83b0-e6a162c2f871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:31.190408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c5415-8bdd-45b5-83b0-e6a162c2f871 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:31.203699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 347/699] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:31.208733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c5415-8bdd-45b5-83b0-e6a162c2f871 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:31.284940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e657032-843a-482d-adcf-9564516c0087 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:31.323360 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c5415-8bdd-45b5-83b0-e6a162c2f871 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:31.328380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cb17-b41c-4576-9932-ba07c3be4077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:31.328380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb17-b41c-4576-9932-ba07c3be4077 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:31.328380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb17-b41c-4576-9932-ba07c3be4077 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:31.328380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb17-b41c-4576-9932-ba07c3be4077 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:31.328885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cb17-b41c-4576-9932-ba07c3be4077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:31.329217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cb17-b41c-4576-9932-ba07c3be4077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:31.330622 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cb17-b41c-4576-9932-ba07c3be4077 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:31.343916 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 353/700] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:31.349998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cb17-b41c-4576-9932-ba07c3be4077 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:31.365276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbde2e-d8fd-4107-bcc2-5e7df973edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:31.366095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbde2e-d8fd-4107-bcc2-5e7df973edee None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:31.366377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbde2e-d8fd-4107-bcc2-5e7df973edee None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:31.366651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbde2e-d8fd-4107-bcc2-5e7df973edee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:31.377427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbde2e-d8fd-4107-bcc2-5e7df973edee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:31.378879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbde2e-d8fd-4107-bcc2-5e7df973edee None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:31.379749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5cbbde2e-d8fd-4107-bcc2-5e7df973edee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:31.396367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:31.397424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:31.398348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:31.398348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:31.398348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:31.398348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:31.398348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:31.398348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:31.398348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:31.398348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:31.398348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:31.398348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:31.398348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 348/701] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Jul 6 20:18:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:31.403405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbde2e-d8fd-4107-bcc2-5e7df973edee None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:31.463889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:31.473195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cb17-b41c-4576-9932-ba07c3be4077 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:31.512138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91745862-1dfa-4879-b086-21915cc21040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:31.512822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91745862-1dfa-4879-b086-21915cc21040 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:31.513132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91745862-1dfa-4879-b086-21915cc21040 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:31.513407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91745862-1dfa-4879-b086-21915cc21040 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:31.514115 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91745862-1dfa-4879-b086-21915cc21040 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:31.515560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91745862-1dfa-4879-b086-21915cc21040 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:31.536151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbde2e-d8fd-4107-bcc2-5e7df973edee None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:31.546077 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 354/702] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:18:31 2022] POST /identity/v3/users => generated 254 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:31.583497 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0aa57-542e-4b2f-aa61-88406711de2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:31.584150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0aa57-542e-4b2f-aa61-88406711de2c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:31.584438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0aa57-542e-4b2f-aa61-88406711de2c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:31.584713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0aa57-542e-4b2f-aa61-88406711de2c None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:31.585626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0aa57-542e-4b2f-aa61-88406711de2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:31.585938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0aa57-542e-4b2f-aa61-88406711de2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:31.587411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0aa57-542e-4b2f-aa61-88406711de2c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:31.608877 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 349/703] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jul 6 20:18:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:31.614783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91745862-1dfa-4879-b086-21915cc21040 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:31.720765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:31.730486 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbe9b1-763a-46e3-9b32-31e805ce76c2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:31.730768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbe9b1-763a-46e3-9b32-31e805ce76c2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:31.731047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbe9b1-763a-46e3-9b32-31e805ce76c2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:31.732641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 350/704] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:18:31.742719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69ab6-02b8-4189-bb99-0bdd82893260 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:31.743043 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69ab6-02b8-4189-bb99-0bdd82893260 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:31.743328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69ab6-02b8-4189-bb99-0bdd82893260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:31.770993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1df69ab6-02b8-4189-bb99-0bdd82893260 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:31.773088 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1df69ab6-02b8-4189-bb99-0bdd82893260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:31.777442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91745862-1dfa-4879-b086-21915cc21040 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:31.830205 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091bde9-bef6-4c85-a83f-73c53f96c99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:31.830945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091bde9-bef6-4c85-a83f-73c53f96c99a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:31.831294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091bde9-bef6-4c85-a83f-73c53f96c99a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:31.831634 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091bde9-bef6-4c85-a83f-73c53f96c99a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:31.882328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 351/705] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:31.901407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091bde9-bef6-4c85-a83f-73c53f96c99a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:31.902886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091bde9-bef6-4c85-a83f-73c53f96c99a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:31.905697 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df69ab6-02b8-4189-bb99-0bdd82893260 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:31.950817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:31.983527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:32.006105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 355/706] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:32.013282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091bde9-bef6-4c85-a83f-73c53f96c99a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:32.020680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df69ab6-02b8-4189-bb99-0bdd82893260 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:32.056456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba156b-a735-4b15-b054-ffeb6cc04bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:32.057593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba156b-a735-4b15-b054-ffeb6cc04bdc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:32.058014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba156b-a735-4b15-b054-ffeb6cc04bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:32.058450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba156b-a735-4b15-b054-ffeb6cc04bdc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:32.059350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba156b-a735-4b15-b054-ffeb6cc04bdc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:32.060982 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba156b-a735-4b15-b054-ffeb6cc04bdc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8fba156b-a735-4b15-b054-ffeb6cc04bdc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:32.076469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:32.077717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:18:32.078568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:32.083302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 352/707] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jul 6 20:18:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:32.087016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba156b-a735-4b15-b054-ffeb6cc04bdc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:32.122948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091bde9-bef6-4c85-a83f-73c53f96c99a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:32.168092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e561ea-11dc-4bec-a51d-832e92d7b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:32.171571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e561ea-11dc-4bec-a51d-832e92d7b6fa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:32.171849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e561ea-11dc-4bec-a51d-832e92d7b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:32.172124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e561ea-11dc-4bec-a51d-832e92d7b6fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:32.193962 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e561ea-11dc-4bec-a51d-832e92d7b6fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:32.195475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e561ea-11dc-4bec-a51d-832e92d7b6fa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-05e561ea-11dc-4bec-a51d-832e92d7b6fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:32.215582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:32.216505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:32.217442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:32.217442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:32.217442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:32.217442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:32.219863 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 356/708] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:32.221384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942e4a-7884-4a41-b406-555f65785a13 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:32.221988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942e4a-7884-4a41-b406-555f65785a13 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:32.222471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942e4a-7884-4a41-b406-555f65785a13 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:32.228003 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba156b-a735-4b15-b054-ffeb6cc04bdc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:32.228284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 357/709] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:32.228706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:32.230502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05942e4a-7884-4a41-b406-555f65785a13 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:32.269434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:32.270452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d58f60-eda1-4996-8c7c-b2c4cc2481c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:32.271134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58f60-eda1-4996-8c7c-b2c4cc2481c0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:32.271416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58f60-eda1-4996-8c7c-b2c4cc2481c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:32.271757 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58f60-eda1-4996-8c7c-b2c4cc2481c0 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:32.272600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d58f60-eda1-4996-8c7c-b2c4cc2481c0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:32.272988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d58f60-eda1-4996-8c7c-b2c4cc2481c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:32.274520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d58f60-eda1-4996-8c7c-b2c4cc2481c0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:32.281649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 353/710] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jul 6 20:18:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:32.283099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6646-4311-4e3e-b845-becc68b1e46e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:32.283385 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6646-4311-4e3e-b845-becc68b1e46e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:32.283660 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6646-4311-4e3e-b845-becc68b1e46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:32.305765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d94a6646-4311-4e3e-b845-becc68b1e46e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:32.306962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d94a6646-4311-4e3e-b845-becc68b1e46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:32.346176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05942e4a-7884-4a41-b406-555f65785a13 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:32.383288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae446e-75d4-4cd6-8bcf-4e75fb10b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:32.383969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae446e-75d4-4cd6-8bcf-4e75fb10b182 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:32.384251 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae446e-75d4-4cd6-8bcf-4e75fb10b182 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:32.384526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae446e-75d4-4cd6-8bcf-4e75fb10b182 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:32.385292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae446e-75d4-4cd6-8bcf-4e75fb10b182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:32.385611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae446e-75d4-4cd6-8bcf-4e75fb10b182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:32.387091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae446e-75d4-4cd6-8bcf-4e75fb10b182 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:32.404147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 358/712] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:32.404459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 354/712] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:32.404968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae446e-75d4-4cd6-8bcf-4e75fb10b182 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:32.406637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a6646-4311-4e3e-b845-becc68b1e46e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:32.520771 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:32.532885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae446e-75d4-4cd6-8bcf-4e75fb10b182 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:32.538344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:32.547067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a6646-4311-4e3e-b845-becc68b1e46e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:32.571718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20405e01-31b1-48fc-a271-cc217c5c6424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:32.572395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20405e01-31b1-48fc-a271-cc217c5c6424 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:32.572677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20405e01-31b1-48fc-a271-cc217c5c6424 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:32.572966 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20405e01-31b1-48fc-a271-cc217c5c6424 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:32.573703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20405e01-31b1-48fc-a271-cc217c5c6424 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:32.574371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20405e01-31b1-48fc-a271-cc217c5c6424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:32.575563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20405e01-31b1-48fc-a271-cc217c5c6424 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:32.582252 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 359/713] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jul 6 20:18:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:32.583210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20405e01-31b1-48fc-a271-cc217c5c6424 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:32.591606 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d341adf-bdf4-416e-adf2-c5c71a7d59f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:32.592909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d341adf-bdf4-416e-adf2-c5c71a7d59f0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:32.594217 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d341adf-bdf4-416e-adf2-c5c71a7d59f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:32.594702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d341adf-bdf4-416e-adf2-c5c71a7d59f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:32.610288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d341adf-bdf4-416e-adf2-c5c71a7d59f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:32.612227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d341adf-bdf4-416e-adf2-c5c71a7d59f0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2d341adf-bdf4-416e-adf2-c5c71a7d59f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:32.629601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:32.630670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:32.631975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:32.631975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:32.631975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:32.631975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:32.631975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:32.631975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:32.631975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:32.631975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:32.634960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 355/714] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:32.646359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d341adf-bdf4-416e-adf2-c5c71a7d59f0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:32.783983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20405e01-31b1-48fc-a271-cc217c5c6424 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:32.834420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a480c-5f74-4a7a-a3e9-2817fe79b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:32.835242 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a480c-5f74-4a7a-a3e9-2817fe79b807 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:32.835522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a480c-5f74-4a7a-a3e9-2817fe79b807 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:32.835794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a480c-5f74-4a7a-a3e9-2817fe79b807 None admin] PATH_INFO: `/v3/services/network` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:32.836456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a480c-5f74-4a7a-a3e9-2817fe79b807 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:32.837905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a480c-5f74-4a7a-a3e9-2817fe79b807 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2a4a480c-5f74-4a7a-a3e9-2817fe79b807 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:32.858471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:32.859490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:32.860347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 360/715] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:32 2022] GET /identity/v3/services/network => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:32.865742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a480c-5f74-4a7a-a3e9-2817fe79b807 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:32.878856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d341adf-bdf4-416e-adf2-c5c71a7d59f0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:32.890657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:32.951683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670e28c-c683-4ddf-93f1-b96c08ca3021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:32.952409 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670e28c-c683-4ddf-93f1-b96c08ca3021 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:32.952633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670e28c-c683-4ddf-93f1-b96c08ca3021 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:32.952909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670e28c-c683-4ddf-93f1-b96c08ca3021 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:32.953743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670e28c-c683-4ddf-93f1-b96c08ca3021 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:32.954060 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670e28c-c683-4ddf-93f1-b96c08ca3021 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:32.955534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670e28c-c683-4ddf-93f1-b96c08ca3021 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:32.974398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 356/716] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:32.977104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670e28c-c683-4ddf-93f1-b96c08ca3021 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:33.012511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:33.041165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a480c-5f74-4a7a-a3e9-2817fe79b807 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:33.076574 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ca141-faf7-4640-9cc7-357998d5b2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:33.077300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca141-faf7-4640-9cc7-357998d5b2db None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:33.077584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca141-faf7-4640-9cc7-357998d5b2db None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:33.077857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca141-faf7-4640-9cc7-357998d5b2db None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:33.080978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ca141-faf7-4640-9cc7-357998d5b2db None admin] RBAC: Adding query filter params (name=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:33.080978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ca141-faf7-4640-9cc7-357998d5b2db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:33.080978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ca141-faf7-4640-9cc7-357998d5b2db None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:33.085491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 361/717] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:18:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:33.091078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ca141-faf7-4640-9cc7-357998d5b2db None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:33.172914 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670e28c-c683-4ddf-93f1-b96c08ca3021 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:33.218399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:33.238354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717cfe6-35f5-4970-8262-4314e5e96af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:33.239356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717cfe6-35f5-4970-8262-4314e5e96af4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:33.239465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ca141-faf7-4640-9cc7-357998d5b2db None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:33.239979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717cfe6-35f5-4970-8262-4314e5e96af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:33.240520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717cfe6-35f5-4970-8262-4314e5e96af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:33.241790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717cfe6-35f5-4970-8262-4314e5e96af4 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=56ad461f6dc54014a956e5c8a094352c) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:33.242301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717cfe6-35f5-4970-8262-4314e5e96af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:33.243937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717cfe6-35f5-4970-8262-4314e5e96af4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:33.250350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 357/718] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:32 2022] GET /identity/v3/role_assignments?user.id=56ad461f6dc54014a956e5c8a094352c&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:33.299091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9721fa7-da38-40a2-afba-111544e5ba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:33.299755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9721fa7-da38-40a2-afba-111544e5ba7d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:33.300043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9721fa7-da38-40a2-afba-111544e5ba7d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:33.300323 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9721fa7-da38-40a2-afba-111544e5ba7d None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:33.301077 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9721fa7-da38-40a2-afba-111544e5ba7d None admin] RBAC: Adding query filter params (type=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:33.301397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9721fa7-da38-40a2-afba-111544e5ba7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:33.302877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9721fa7-da38-40a2-afba-111544e5ba7d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:33.312676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 362/719] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:18:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:33.596197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7c852-2aeb-42f5-83d0-281936b2bccc None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:33.596826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7c852-2aeb-42f5-83d0-281936b2bccc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:33.597361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7c852-2aeb-42f5-83d0-281936b2bccc None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:33.599185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 358/720] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:33.609110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463227c6-1067-4fec-8ed1-e4d0cef45750 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:33.609400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463227c6-1067-4fec-8ed1-e4d0cef45750 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:33.609653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463227c6-1067-4fec-8ed1-e4d0cef45750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:33.629780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-463227c6-1067-4fec-8ed1-e4d0cef45750 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:33.631050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-463227c6-1067-4fec-8ed1-e4d0cef45750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:33.709577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 363/721] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:33.732313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7c852-2aeb-42f5-83d0-281936b2bccc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:33.851078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:33.878110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7c852-2aeb-42f5-83d0-281936b2bccc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:33.930558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b090614-31fc-444f-8f23-92503616b848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:33.931373 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b090614-31fc-444f-8f23-92503616b848 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:33.931656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b090614-31fc-444f-8f23-92503616b848 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:33.931932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b090614-31fc-444f-8f23-92503616b848 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:33.947305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b090614-31fc-444f-8f23-92503616b848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1b090614-31fc-444f-8f23-92503616b848 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:33.954969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:33.956302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:33.957503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 359/722] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:33.963124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463227c6-1067-4fec-8ed1-e4d0cef45750 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:34.028103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477c997-6e05-49dc-9855-43d136c93b7c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:34.028766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477c997-6e05-49dc-9855-43d136c93b7c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:34.029272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477c997-6e05-49dc-9855-43d136c93b7c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:34.031099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 360/723] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:34.036270 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264ae00-e6af-4b74-b1e9-16b19dd88601 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:34.036821 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264ae00-e6af-4b74-b1e9-16b19dd88601 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:34.037367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264ae00-e6af-4b74-b1e9-16b19dd88601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:34.069100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4264ae00-e6af-4b74-b1e9-16b19dd88601 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:34.070302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4264ae00-e6af-4b74-b1e9-16b19dd88601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:34.099687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:34.152794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463227c6-1067-4fec-8ed1-e4d0cef45750 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:34.156768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 361/724] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:18:34.184189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264ae00-e6af-4b74-b1e9-16b19dd88601 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:34.227138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91c927-1862-4788-9115-5803df5956c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:34.227812 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91c927-1862-4788-9115-5803df5956c3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:34.228082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91c927-1862-4788-9115-5803df5956c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:34.228347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91c927-1862-4788-9115-5803df5956c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:34.229125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91c927-1862-4788-9115-5803df5956c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:34.229428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91c927-1862-4788-9115-5803df5956c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:34.230789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91c927-1862-4788-9115-5803df5956c3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:34.241839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 364/725] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:34.247472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91c927-1862-4788-9115-5803df5956c3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:34.301335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:34.356374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264ae00-e6af-4b74-b1e9-16b19dd88601 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:34.411056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91c927-1862-4788-9115-5803df5956c3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:34.416435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497b08-3308-43eb-9afe-d7ebd0aeb253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:34.418376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497b08-3308-43eb-9afe-d7ebd0aeb253 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:34.418654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497b08-3308-43eb-9afe-d7ebd0aeb253 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:34.418921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497b08-3308-43eb-9afe-d7ebd0aeb253 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:34.439857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f497b08-3308-43eb-9afe-d7ebd0aeb253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3f497b08-3308-43eb-9afe-d7ebd0aeb253 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:34.449584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:34.450483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:34.451317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:34.454020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 362/726] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:34.459878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497b08-3308-43eb-9afe-d7ebd0aeb253 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:34.490036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713d9c1-d0f5-400f-8499-968925479c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:34.491020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713d9c1-d0f5-400f-8499-968925479c63 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:34.491297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713d9c1-d0f5-400f-8499-968925479c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:34.491566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713d9c1-d0f5-400f-8499-968925479c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:34.502818 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:34.511515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713d9c1-d0f5-400f-8499-968925479c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:34.512992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713d9c1-d0f5-400f-8499-968925479c63 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f713d9c1-d0f5-400f-8499-968925479c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:34.543076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:34.544020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:34.544890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:34.544890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:34.544890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:34.544890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:34.544890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 365/727] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:34.550324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713d9c1-d0f5-400f-8499-968925479c63 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:34.599350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497b08-3308-43eb-9afe-d7ebd0aeb253 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:34.657308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:34.665260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f766587-5581-4fab-89bf-3ee2fffccdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:34.665888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f766587-5581-4fab-89bf-3ee2fffccdfc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:34.666171 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f766587-5581-4fab-89bf-3ee2fffccdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:34.666443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f766587-5581-4fab-89bf-3ee2fffccdfc None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:34.667206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f766587-5581-4fab-89bf-3ee2fffccdfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:34.667513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f766587-5581-4fab-89bf-3ee2fffccdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:34.668899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f766587-5581-4fab-89bf-3ee2fffccdfc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:34.678950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 363/728] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:34.684724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f766587-5581-4fab-89bf-3ee2fffccdfc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:34.749407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713d9c1-d0f5-400f-8499-968925479c63 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:34.817289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743a53d-2a2e-4b43-8abf-4fe6f6530e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:34.817966 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a53d-2a2e-4b43-8abf-4fe6f6530e5c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:34.818295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a53d-2a2e-4b43-8abf-4fe6f6530e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:34.818572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a53d-2a2e-4b43-8abf-4fe6f6530e5c None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:34.819311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743a53d-2a2e-4b43-8abf-4fe6f6530e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:34.819616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743a53d-2a2e-4b43-8abf-4fe6f6530e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:34.821035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743a53d-2a2e-4b43-8abf-4fe6f6530e5c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:34.848918 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 366/729] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:34.855183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743a53d-2a2e-4b43-8abf-4fe6f6530e5c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:34.871510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f766587-5581-4fab-89bf-3ee2fffccdfc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:34.936057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc15fe1-de35-43ef-af77-6772a7680fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:34.936791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15fe1-de35-43ef-af77-6772a7680fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:34.937098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15fe1-de35-43ef-af77-6772a7680fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:34.937377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15fe1-de35-43ef-af77-6772a7680fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:34.959804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc15fe1-de35-43ef-af77-6772a7680fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:34.960862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:34.961313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc15fe1-de35-43ef-af77-6772a7680fa9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4bc15fe1-de35-43ef-af77-6772a7680fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:34.996476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:34.997492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:34.998396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:34.998396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:34.998396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:34.998396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:35.004599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 364/730] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:35.008369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc15fe1-de35-43ef-af77-6772a7680fa9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:35.053309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743a53d-2a2e-4b43-8abf-4fe6f6530e5c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:35.088553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:35.103098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efb21e-4a0c-4bb2-9953-043fe60ea78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:35.104189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb21e-4a0c-4bb2-9953-043fe60ea78c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.104467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb21e-4a0c-4bb2-9953-043fe60ea78c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.104739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb21e-4a0c-4bb2-9953-043fe60ea78c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.114560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb21e-4a0c-4bb2-9953-043fe60ea78c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:35.116048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb21e-4a0c-4bb2-9953-043fe60ea78c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-00efb21e-4a0c-4bb2-9953-043fe60ea78c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:35.138837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:35.139799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:35.140710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:35.140710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:35.140710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:35.140710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:35.140710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:35.140710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:35.140710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:35.140710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:35.140710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:35.140710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:35.141267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 367/731] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:35.142160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e46ee-513a-4c30-a048-24ac046697bb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.144645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e46ee-513a-4c30-a048-24ac046697bb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.144645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e46ee-513a-4c30-a048-24ac046697bb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.148291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 368/732] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:35.149430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e46ee-513a-4c30-a048-24ac046697bb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:35.151304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc15fe1-de35-43ef-af77-6772a7680fa9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:35.191654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f62a7-364f-480e-9e4d-f1ceec79af73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:35.192353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f62a7-364f-480e-9e4d-f1ceec79af73 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.192709 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f62a7-364f-480e-9e4d-f1ceec79af73 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.193074 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f62a7-364f-480e-9e4d-f1ceec79af73 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.193945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f62a7-364f-480e-9e4d-f1ceec79af73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:35.194315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f62a7-364f-480e-9e4d-f1ceec79af73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:35.195778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f62a7-364f-480e-9e4d-f1ceec79af73 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:35.210059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 365/733] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:35.211567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2515ed1-0f8e-4c0d-8a53-189c8d846600 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.212025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2515ed1-0f8e-4c0d-8a53-189c8d846600 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.212387 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2515ed1-0f8e-4c0d-8a53-189c8d846600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.229184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f2515ed1-0f8e-4c0d-8a53-189c8d846600 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:35.230460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f2515ed1-0f8e-4c0d-8a53-189c8d846600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:35.276174 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e46ee-513a-4c30-a048-24ac046697bb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:35.289788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:35.307511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 366/734] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:35.308817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2515ed1-0f8e-4c0d-8a53-189c8d846600 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:35.336687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf94ba0-6e65-494d-9e81-ce0e08948492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:35.337487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94ba0-6e65-494d-9e81-ce0e08948492 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.337904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94ba0-6e65-494d-9e81-ce0e08948492 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.338186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94ba0-6e65-494d-9e81-ce0e08948492 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.339344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf94ba0-6e65-494d-9e81-ce0e08948492 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:35.339665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf94ba0-6e65-494d-9e81-ce0e08948492 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:35.341384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf94ba0-6e65-494d-9e81-ce0e08948492 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:35.356600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:35.371963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 369/735] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jul 6 20:18:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:35.373880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf94ba0-6e65-494d-9e81-ce0e08948492 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:35.437935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2515ed1-0f8e-4c0d-8a53-189c8d846600 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:35.482391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b6e61-7b16-4dc3-a0d5-6c329b1614e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:35.484027 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6e61-7b16-4dc3-a0d5-6c329b1614e2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.484780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6e61-7b16-4dc3-a0d5-6c329b1614e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.485273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6e61-7b16-4dc3-a0d5-6c329b1614e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.489674 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf94ba0-6e65-494d-9e81-ce0e08948492 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:35.495013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b6e61-7b16-4dc3-a0d5-6c329b1614e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:35.496708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b6e61-7b16-4dc3-a0d5-6c329b1614e2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-002b6e61-7b16-4dc3-a0d5-6c329b1614e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:35.516464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:35.517469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:35.518406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:35.518406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:35.518406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:35.518406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:35.518406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:35.518406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:35.518406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:35.518406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:35.518406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:35.518406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:35.521143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 367/736] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jul 6 20:18:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:35.522308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b6e61-7b16-4dc3-a0d5-6c329b1614e2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:35.528009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1cd79-e4b0-42a1-9e63-aa4aac722ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:35.528932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1cd79-e4b0-42a1-9e63-aa4aac722ac4 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.529657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1cd79-e4b0-42a1-9e63-aa4aac722ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.530036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1cd79-e4b0-42a1-9e63-aa4aac722ac4 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.530927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1cd79-e4b0-42a1-9e63-aa4aac722ac4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:35.532479 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1cd79-e4b0-42a1-9e63-aa4aac722ac4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:35.561002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 370/737] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:18:35 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:35.561002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1cd79-e4b0-42a1-9e63-aa4aac722ac4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:35.594518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:35.659955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:35.669260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b6e61-7b16-4dc3-a0d5-6c329b1614e2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:35.717728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1cd79-e4b0-42a1-9e63-aa4aac722ac4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:35.728570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421092d8-86ff-4b78-b91c-f59c61d1f71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:35.728570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421092d8-86ff-4b78-b91c-f59c61d1f71b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.728570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421092d8-86ff-4b78-b91c-f59c61d1f71b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.728570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421092d8-86ff-4b78-b91c-f59c61d1f71b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.767474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59fb9e-caf8-4d9c-b284-6db2e45a991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:35.768268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59fb9e-caf8-4d9c-b284-6db2e45a991d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.768389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59fb9e-caf8-4d9c-b284-6db2e45a991d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.768593 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59fb9e-caf8-4d9c-b284-6db2e45a991d None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.769494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59fb9e-caf8-4d9c-b284-6db2e45a991d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:35.769797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59fb9e-caf8-4d9c-b284-6db2e45a991d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:35.771250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59fb9e-caf8-4d9c-b284-6db2e45a991d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:35.794201 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 371/738] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Jul 6 20:18:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:35.795882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6928c22-fa42-4658-bb19-5b2672d305a3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.796166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6928c22-fa42-4658-bb19-5b2672d305a3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.796492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6928c22-fa42-4658-bb19-5b2672d305a3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.798169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 372/739] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:35.799529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee729e4-7bd3-4191-8e58-001b557f61aa None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.799808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee729e4-7bd3-4191-8e58-001b557f61aa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.800074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee729e4-7bd3-4191-8e58-001b557f61aa None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.801987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 373/740] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:35.802892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee729e4-7bd3-4191-8e58-001b557f61aa None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:35.819355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421092d8-86ff-4b78-b91c-f59c61d1f71b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:35.820826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421092d8-86ff-4b78-b91c-f59c61d1f71b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:35.894872 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:35.914039 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:35.914928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee729e4-7bd3-4191-8e58-001b557f61aa None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:35.925590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 368/741] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:35 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:35.927139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4910-9d6d-4fd6-b7f4-069c7a014105 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.927420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4910-9d6d-4fd6-b7f4-069c7a014105 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.927723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4910-9d6d-4fd6-b7f4-069c7a014105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:35.945572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d68f4910-9d6d-4fd6-b7f4-069c7a014105 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:35.946738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d68f4910-9d6d-4fd6-b7f4-069c7a014105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:35.955513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79851da2-9eee-4f1e-9a92-000d1ca916d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:35.956174 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79851da2-9eee-4f1e-9a92-000d1ca916d8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:35.956454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79851da2-9eee-4f1e-9a92-000d1ca916d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:35.956727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79851da2-9eee-4f1e-9a92-000d1ca916d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:36.020944 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 369/742] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:36.022297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc6984-d5f7-4a4d-b4c8-e95a18a27b61 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:36.022661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc6984-d5f7-4a4d-b4c8-e95a18a27b61 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:36.022944 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc6984-d5f7-4a4d-b4c8-e95a18a27b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:36.032850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79851da2-9eee-4f1e-9a92-000d1ca916d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:36.036177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79851da2-9eee-4f1e-9a92-000d1ca916d8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:36.041922 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-62bc6984-d5f7-4a4d-b4c8-e95a18a27b61 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:36.043104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-62bc6984-d5f7-4a4d-b4c8-e95a18a27b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:36.125032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 370/743] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:18:36.125032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc6984-d5f7-4a4d-b4c8-e95a18a27b61 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:36.125809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:36.143731 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 374/744] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:35 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:18:36.144785 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79851da2-9eee-4f1e-9a92-000d1ca916d8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:36.174833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:36.228795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc6984-d5f7-4a4d-b4c8-e95a18a27b61 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:36.246983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79851da2-9eee-4f1e-9a92-000d1ca916d8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:36.265693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c63dfc-ed3e-4ebd-83a0-5a122939458a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:36.266500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63dfc-ed3e-4ebd-83a0-5a122939458a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:36.266774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63dfc-ed3e-4ebd-83a0-5a122939458a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:36.267043 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63dfc-ed3e-4ebd-83a0-5a122939458a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:36.279347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c63dfc-ed3e-4ebd-83a0-5a122939458a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:36.280753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c63dfc-ed3e-4ebd-83a0-5a122939458a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:36.284620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a2f2-ed2c-4e39-bc28-b80f843df5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:36.285459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a2f2-ed2c-4e39-bc28-b80f843df5bd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:36.285737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a2f2-ed2c-4e39-bc28-b80f843df5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:36.286009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a2f2-ed2c-4e39-bc28-b80f843df5bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:36.297437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63a2f2-ed2c-4e39-bc28-b80f843df5bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-30c63dfc-ed3e-4ebd-83a0-5a122939458a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:36.299398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:36.300265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:36.301176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:36.301176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:36.301176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:36.301176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:36.305295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 371/745] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:36.306354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c63dfc-ed3e-4ebd-83a0-5a122939458a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bd63a2f2-ed2c-4e39-bc28-b80f843df5bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:36.306596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:36.307542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:36.308395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 375/746] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:36.309113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a2f2-ed2c-4e39-bc28-b80f843df5bd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:36.364939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:36.429340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a2f2-ed2c-4e39-bc28-b80f843df5bd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:36.467201 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a988de-96a3-4a41-bb92-112f74b49974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:36.468009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a988de-96a3-4a41-bb92-112f74b49974 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:36.468297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a988de-96a3-4a41-bb92-112f74b49974 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:36.468568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a988de-96a3-4a41-bb92-112f74b49974 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:36.470087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a988de-96a3-4a41-bb92-112f74b49974 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:36.471468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a988de-96a3-4a41-bb92-112f74b49974 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:36.493010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 376/747] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:18:36 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:36.493010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a988de-96a3-4a41-bb92-112f74b49974 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:36.539675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c63dfc-ed3e-4ebd-83a0-5a122939458a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:36.541633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:36.589808 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41019665-d0c5-4c61-b71d-d8e5f6f0a5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:36.590913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41019665-d0c5-4c61-b71d-d8e5f6f0a5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:36.591196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41019665-d0c5-4c61-b71d-d8e5f6f0a5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:36.591469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41019665-d0c5-4c61-b71d-d8e5f6f0a5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:36.606801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41019665-d0c5-4c61-b71d-d8e5f6f0a5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:36.608801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41019665-d0c5-4c61-b71d-d8e5f6f0a5e5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:36.626695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a988de-96a3-4a41-bb92-112f74b49974 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-41019665-d0c5-4c61-b71d-d8e5f6f0a5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:36.633234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:36.634198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:36.635098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:36.635098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:36.635098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:36.635098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:36.635098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 372/748] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:36.636377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41019665-d0c5-4c61-b71d-d8e5f6f0a5e5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:36.639331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:36.677214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e511a-533c-4522-85ea-6718c3a55ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:36.678215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e511a-533c-4522-85ea-6718c3a55ebb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:36.678626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e511a-533c-4522-85ea-6718c3a55ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:36.679043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e511a-533c-4522-85ea-6718c3a55ebb None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:36.680128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e511a-533c-4522-85ea-6718c3a55ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:36.680566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e511a-533c-4522-85ea-6718c3a55ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:36.682175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e511a-533c-4522-85ea-6718c3a55ebb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:36.695488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 377/749] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:36.696618 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e511a-533c-4522-85ea-6718c3a55ebb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:36.767391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41019665-d0c5-4c61-b71d-d8e5f6f0a5e5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:36.816844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e511a-533c-4522-85ea-6718c3a55ebb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:36.819758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5c87d-313c-44f0-87c0-cb9dccb6a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:36.820442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5c87d-313c-44f0-87c0-cb9dccb6a485 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:36.820726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5c87d-313c-44f0-87c0-cb9dccb6a485 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:36.821019 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5c87d-313c-44f0-87c0-cb9dccb6a485 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:36.824421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5c87d-313c-44f0-87c0-cb9dccb6a485 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:36.824421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5c87d-313c-44f0-87c0-cb9dccb6a485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:36.824421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5c87d-313c-44f0-87c0-cb9dccb6a485 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:36.836770 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 373/750] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:36.838147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5c87d-313c-44f0-87c0-cb9dccb6a485 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:36.859489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:36.866194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7e505-8531-4bac-ad55-b3c862b5ffaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:36.867104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7e505-8531-4bac-ad55-b3c862b5ffaa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:36.867476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7e505-8531-4bac-ad55-b3c862b5ffaa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:36.867811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7e505-8531-4bac-ad55-b3c862b5ffaa None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:36.868658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7e505-8531-4bac-ad55-b3c862b5ffaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:36.869060 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7e505-8531-4bac-ad55-b3c862b5ffaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:36.870698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7e505-8531-4bac-ad55-b3c862b5ffaa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:36.888394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 378/751] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:36.888394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7e505-8531-4bac-ad55-b3c862b5ffaa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:36.916390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:36.974277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5c87d-313c-44f0-87c0-cb9dccb6a485 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:37.004874 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7e505-8531-4bac-ad55-b3c862b5ffaa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:37.009688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf5f5e-ba5b-4ade-8abe-64f2b8cc6d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:37.010634 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf5f5e-ba5b-4ade-8abe-64f2b8cc6d14 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.010976 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf5f5e-ba5b-4ade-8abe-64f2b8cc6d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.011355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf5f5e-ba5b-4ade-8abe-64f2b8cc6d14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.018459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf5f5e-ba5b-4ade-8abe-64f2b8cc6d14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:37.020024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf5f5e-ba5b-4ade-8abe-64f2b8cc6d14 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f3bf5f5e-ba5b-4ade-8abe-64f2b8cc6d14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:37.034197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:37.035520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:37.036378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:37.036378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:37.036378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:37.036378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:37.036378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:37.036378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:37.036378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:37.036378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:37.040423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 374/752] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:37.041459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf5f5e-ba5b-4ade-8abe-64f2b8cc6d14 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:37.048274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83343cb9-2db8-4d55-9bb5-f12e66c65fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:37.049344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343cb9-2db8-4d55-9bb5-f12e66c65fab None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.049843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343cb9-2db8-4d55-9bb5-f12e66c65fab None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.050313 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343cb9-2db8-4d55-9bb5-f12e66c65fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.064255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83343cb9-2db8-4d55-9bb5-f12e66c65fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:37.066683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83343cb9-2db8-4d55-9bb5-f12e66c65fab None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-83343cb9-2db8-4d55-9bb5-f12e66c65fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:37.088985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:37.089895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:37.090781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:37.090781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:37.090781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:37.090781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:37.093319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 379/753] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:37.094436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83343cb9-2db8-4d55-9bb5-f12e66c65fab None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:37.115946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:37.149553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf5f5e-ba5b-4ade-8abe-64f2b8cc6d14 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:37.184104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2caf51-8205-4974-af29-800c21d2e452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:37.185099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2caf51-8205-4974-af29-800c21d2e452 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.185474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2caf51-8205-4974-af29-800c21d2e452 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.186084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2caf51-8205-4974-af29-800c21d2e452 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.193300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2caf51-8205-4974-af29-800c21d2e452 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:37.195114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2caf51-8205-4974-af29-800c21d2e452 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:37.201369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1c2caf51-8205-4974-af29-800c21d2e452 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:37.211855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:37.212990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:37.214099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:37.214099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:37.214099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:37.214099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:37.214099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:37.214099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:37.214099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:37.214099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:37.220550 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 375/754] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:37.221784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2caf51-8205-4974-af29-800c21d2e452 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:37.232994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83343cb9-2db8-4d55-9bb5-f12e66c65fab None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:37.275445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed40c8-6ef9-40b9-bda0-d5f3b5e1a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:37.276273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed40c8-6ef9-40b9-bda0-d5f3b5e1a797 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.276645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed40c8-6ef9-40b9-bda0-d5f3b5e1a797 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.277053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed40c8-6ef9-40b9-bda0-d5f3b5e1a797 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.278019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed40c8-6ef9-40b9-bda0-d5f3b5e1a797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:37.278475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed40c8-6ef9-40b9-bda0-d5f3b5e1a797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:37.280043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed40c8-6ef9-40b9-bda0-d5f3b5e1a797 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:37.293156 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 380/755] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:37.299070 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed40c8-6ef9-40b9-bda0-d5f3b5e1a797 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:37.347973 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2caf51-8205-4974-af29-800c21d2e452 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:37.388538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:37.399758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dc805-567e-4469-8e40-5bf8f4b5a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:37.401286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dc805-567e-4469-8e40-5bf8f4b5a63f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.401882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dc805-567e-4469-8e40-5bf8f4b5a63f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.402585 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dc805-567e-4469-8e40-5bf8f4b5a63f None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.404015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dc805-567e-4469-8e40-5bf8f4b5a63f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:37.404560 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dc805-567e-4469-8e40-5bf8f4b5a63f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:37.406095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dc805-567e-4469-8e40-5bf8f4b5a63f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:37.406230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed40c8-6ef9-40b9-bda0-d5f3b5e1a797 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:37.422613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 376/756] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:37.423766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dc805-567e-4469-8e40-5bf8f4b5a63f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:37.451727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d04f-f963-4859-8be6-207cdaef0b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:37.452887 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d04f-f963-4859-8be6-207cdaef0b43 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.453733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d04f-f963-4859-8be6-207cdaef0b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.454156 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d04f-f963-4859-8be6-207cdaef0b43 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.455353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6d04f-f963-4859-8be6-207cdaef0b43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:37.456072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6d04f-f963-4859-8be6-207cdaef0b43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:37.458328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6d04f-f963-4859-8be6-207cdaef0b43 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:37.460387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:37.475841 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 381/757] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:37.476827 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d04f-f963-4859-8be6-207cdaef0b43 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:37.535791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dc805-567e-4469-8e40-5bf8f4b5a63f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:37.571931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce774dca-3c07-42b4-aae4-1f42ed824415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:37.572744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce774dca-3c07-42b4-aae4-1f42ed824415 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.573168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce774dca-3c07-42b4-aae4-1f42ed824415 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.573540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce774dca-3c07-42b4-aae4-1f42ed824415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.574742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce774dca-3c07-42b4-aae4-1f42ed824415 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=b11e395dab424f3492f092eb3d5032dd) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:37.574921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce774dca-3c07-42b4-aae4-1f42ed824415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:37.576503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce774dca-3c07-42b4-aae4-1f42ed824415 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:37.588089 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 377/758] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:37 2022] GET /identity/v3/role_assignments?user.id=b11e395dab424f3492f092eb3d5032dd&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:37.589276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce774dca-3c07-42b4-aae4-1f42ed824415 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:37.604268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d04f-f963-4859-8be6-207cdaef0b43 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:37.648285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26668e-72fe-45a3-bc53-7405e8b4c397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:37.649441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26668e-72fe-45a3-bc53-7405e8b4c397 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.649859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26668e-72fe-45a3-bc53-7405e8b4c397 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.650508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26668e-72fe-45a3-bc53-7405e8b4c397 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.660552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26668e-72fe-45a3-bc53-7405e8b4c397 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:37.662555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26668e-72fe-45a3-bc53-7405e8b4c397 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9c26668e-72fe-45a3-bc53-7405e8b4c397 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:37.682836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:37.684025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:37.685229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:37.685229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:37.685229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:37.685229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:37.685229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:37.685229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:37.685229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:37.685229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:37.685229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:37.685229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:37.688043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 382/759] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Jul 6 20:18:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:37.690246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468991a0-0dc2-4807-a8cb-eb266e5beb1b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.690710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468991a0-0dc2-4807-a8cb-eb266e5beb1b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.691105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468991a0-0dc2-4807-a8cb-eb266e5beb1b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.693240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 383/760] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:37.699019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468991a0-0dc2-4807-a8cb-eb266e5beb1b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:37.702610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:37.753391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce774dca-3c07-42b4-aae4-1f42ed824415 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:37.768003 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:37.790442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6628d9c-0046-4c8d-9090-6dcf2dbd95f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:37.791106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6628d9c-0046-4c8d-9090-6dcf2dbd95f8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.791382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6628d9c-0046-4c8d-9090-6dcf2dbd95f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.791651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6628d9c-0046-4c8d-9090-6dcf2dbd95f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.792522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6628d9c-0046-4c8d-9090-6dcf2dbd95f8 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=d869f947e5b14979b7f44aa19be9ae50) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:37.792834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6628d9c-0046-4c8d-9090-6dcf2dbd95f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:37.794299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6628d9c-0046-4c8d-9090-6dcf2dbd95f8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:37.801160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 378/761] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:37 2022] GET /identity/v3/role_assignments?user.id=d869f947e5b14979b7f44aa19be9ae50&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:37.802228 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9d42-9259-457a-a0d2-7b60c0a9648c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.802596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9d42-9259-457a-a0d2-7b60c0a9648c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.802855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9d42-9259-457a-a0d2-7b60c0a9648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.837486 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-15ed9d42-9259-457a-a0d2-7b60c0a9648c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:37.838801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-15ed9d42-9259-457a-a0d2-7b60c0a9648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:37.846047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468991a0-0dc2-4807-a8cb-eb266e5beb1b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:37.929866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e58b10-d9e2-4d84-9e07-c89769f0a087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:37.930470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e58b10-d9e2-4d84-9e07-c89769f0a087 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:37.932900 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e58b10-d9e2-4d84-9e07-c89769f0a087 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:37.933216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e58b10-d9e2-4d84-9e07-c89769f0a087 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:37.934109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e58b10-d9e2-4d84-9e07-c89769f0a087 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:37.934417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e58b10-d9e2-4d84-9e07-c89769f0a087 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:37.940679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e58b10-d9e2-4d84-9e07-c89769f0a087 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:37.965190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 384/762] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jul 6 20:18:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:37.971263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e58b10-d9e2-4d84-9e07-c89769f0a087 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:37.974644 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 379/763] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:37.999298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9d42-9259-457a-a0d2-7b60c0a9648c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:38.069825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:38.082594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e58b10-d9e2-4d84-9e07-c89769f0a087 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:38.096317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:38.118778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16d3fd-516f-4bbf-ac5c-f16069382888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:38.119651 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16d3fd-516f-4bbf-ac5c-f16069382888 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:38.119853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16d3fd-516f-4bbf-ac5c-f16069382888 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:38.120116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16d3fd-516f-4bbf-ac5c-f16069382888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:38.130355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9d42-9259-457a-a0d2-7b60c0a9648c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:38.130804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16d3fd-516f-4bbf-ac5c-f16069382888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:38.132587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16d3fd-516f-4bbf-ac5c-f16069382888 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5e16d3fd-516f-4bbf-ac5c-f16069382888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:38.150632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:38.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:38.152844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:38.152844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:38.152844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:38.152844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:38.152844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 385/764] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:38.157304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16d3fd-516f-4bbf-ac5c-f16069382888 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:38.183979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c03e1-df52-4ce0-add7-42d73177d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:38.185110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c03e1-df52-4ce0-add7-42d73177d077 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:38.185532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c03e1-df52-4ce0-add7-42d73177d077 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:38.186038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c03e1-df52-4ce0-add7-42d73177d077 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:38.186939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c03e1-df52-4ce0-add7-42d73177d077 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:38.188465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c03e1-df52-4ce0-add7-42d73177d077 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-908c03e1-df52-4ce0-add7-42d73177d077 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:38.212186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:38.213221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:18:38.214400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:38.221147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 380/765] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jul 6 20:18:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:38.223221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c03e1-df52-4ce0-add7-42d73177d077 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:38.267078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16d3fd-516f-4bbf-ac5c-f16069382888 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:38.302840 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede2dd6-f2af-46c0-ab08-cb36422dda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:38.303490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede2dd6-f2af-46c0-ab08-cb36422dda53 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:38.303889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede2dd6-f2af-46c0-ab08-cb36422dda53 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:38.304227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede2dd6-f2af-46c0-ab08-cb36422dda53 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:38.310397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede2dd6-f2af-46c0-ab08-cb36422dda53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:38.310397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede2dd6-f2af-46c0-ab08-cb36422dda53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:38.310397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede2dd6-f2af-46c0-ab08-cb36422dda53 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:38.323558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 386/766] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:38.325928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede2dd6-f2af-46c0-ab08-cb36422dda53 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:38.371061 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:38.418353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c03e1-df52-4ce0-add7-42d73177d077 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:38.441862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:38.482695 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08117051-7ec4-4db2-ac13-c030f21d0e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:38.483369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08117051-7ec4-4db2-ac13-c030f21d0e0a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:38.483643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08117051-7ec4-4db2-ac13-c030f21d0e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:38.483911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08117051-7ec4-4db2-ac13-c030f21d0e0a None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:38.485324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08117051-7ec4-4db2-ac13-c030f21d0e0a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:38.485670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08117051-7ec4-4db2-ac13-c030f21d0e0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:38.487041 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08117051-7ec4-4db2-ac13-c030f21d0e0a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:38.494533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 381/767] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jul 6 20:18:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:38.496392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede2dd6-f2af-46c0-ab08-cb36422dda53 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:38.499612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08117051-7ec4-4db2-ac13-c030f21d0e0a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:38.557110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdafabd-e4d6-4cd8-b2be-39a5c12267d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:38.557961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdafabd-e4d6-4cd8-b2be-39a5c12267d7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:38.558241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdafabd-e4d6-4cd8-b2be-39a5c12267d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:38.558510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdafabd-e4d6-4cd8-b2be-39a5c12267d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:38.571586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdafabd-e4d6-4cd8-b2be-39a5c12267d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:38.573082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdafabd-e4d6-4cd8-b2be-39a5c12267d7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bfdafabd-e4d6-4cd8-b2be-39a5c12267d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:38.599909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:38.600848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:38.602208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:38.602208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:38.602208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:38.602208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:38.602208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:38.602208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:38.602208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:38.602208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:38.602208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 387/768] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:38.609827 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdafabd-e4d6-4cd8-b2be-39a5c12267d7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:38.683961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08117051-7ec4-4db2-ac13-c030f21d0e0a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:38.741175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a838a4-59bc-47f5-a6a2-18484e1391b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:38.741848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a838a4-59bc-47f5-a6a2-18484e1391b9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:38.743631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a838a4-59bc-47f5-a6a2-18484e1391b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:38.743915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a838a4-59bc-47f5-a6a2-18484e1391b9 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:38.744630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a838a4-59bc-47f5-a6a2-18484e1391b9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:38.744934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a838a4-59bc-47f5-a6a2-18484e1391b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:38.746325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a838a4-59bc-47f5-a6a2-18484e1391b9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:38.761472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 382/769] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jul 6 20:18:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:38.765571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a838a4-59bc-47f5-a6a2-18484e1391b9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:38.769301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:38.790996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdafabd-e4d6-4cd8-b2be-39a5c12267d7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:38.848354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:38.852543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eebbc-f869-4479-9d3d-1fe708d39a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:38.853352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eebbc-f869-4479-9d3d-1fe708d39a81 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:38.853630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eebbc-f869-4479-9d3d-1fe708d39a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:38.853959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eebbc-f869-4479-9d3d-1fe708d39a81 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:38.854758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eebbc-f869-4479-9d3d-1fe708d39a81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:38.855071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eebbc-f869-4479-9d3d-1fe708d39a81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:38.856607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eebbc-f869-4479-9d3d-1fe708d39a81 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:38.886923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 388/770] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:38.892241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa06781-1d53-411e-b2fc-1740dd48ab6a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:38.892241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa06781-1d53-411e-b2fc-1740dd48ab6a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:38.892241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa06781-1d53-411e-b2fc-1740dd48ab6a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:38.892241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 389/771] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:38.893136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa06781-1d53-411e-b2fc-1740dd48ab6a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:38.923567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a838a4-59bc-47f5-a6a2-18484e1391b9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:38.965063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244da25a-a541-4baf-b83e-9e32c1dab3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:38.965649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244da25a-a541-4baf-b83e-9e32c1dab3cb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:38.965930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244da25a-a541-4baf-b83e-9e32c1dab3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:38.966205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244da25a-a541-4baf-b83e-9e32c1dab3cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:38.967013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244da25a-a541-4baf-b83e-9e32c1dab3cb None admin] RBAC: Adding query filter params (interface=public, service_id=5abef38deba24f0ba4160aa1f26236e2, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:38.967328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244da25a-a541-4baf-b83e-9e32c1dab3cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:38.968816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244da25a-a541-4baf-b83e-9e32c1dab3cb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:38.977447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 383/772] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Jul 6 20:18:38 2022] GET /identity/v3/endpoints?service_id=5abef38deba24f0ba4160aa1f26236e2&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:38.983202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5d815-d451-4b4a-9fc1-e45d8924d97b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:38.983495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5d815-d451-4b4a-9fc1-e45d8924d97b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:38.983777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5d815-d451-4b4a-9fc1-e45d8924d97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:39.002677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-96e5d815-d451-4b4a-9fc1-e45d8924d97b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:39.003959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-96e5d815-d451-4b4a-9fc1-e45d8924d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:39.014489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa06781-1d53-411e-b2fc-1740dd48ab6a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:39.050438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82bcc-6137-4e87-a0ea-644e4716abfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:39.051835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82bcc-6137-4e87-a0ea-644e4716abfb None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:39.052322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82bcc-6137-4e87-a0ea-644e4716abfb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:39.052837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82bcc-6137-4e87-a0ea-644e4716abfb None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/56ad461f6dc54014a956e5c8a094352c/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:39.055224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b82bcc-6137-4e87-a0ea-644e4716abfb None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=56ad461f6dc54014a956e5c8a094352c, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:39.056967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b82bcc-6137-4e87-a0ea-644e4716abfb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:39.081141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 390/773] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:18:38 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/56ad461f6dc54014a956e5c8a094352c/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:18:39.081141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82bcc-6137-4e87-a0ea-644e4716abfb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:39.082685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 384/774] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:39.086431 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:39.126570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5d815-d451-4b4a-9fc1-e45d8924d97b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:39.212082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:39.216502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82bcc-6137-4e87-a0ea-644e4716abfb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:39.258567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f884b-b521-4c2c-a0d1-cb0f52f30abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:39.259171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f884b-b521-4c2c-a0d1-cb0f52f30abe None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:39.259453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f884b-b521-4c2c-a0d1-cb0f52f30abe None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:39.259723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f884b-b521-4c2c-a0d1-cb0f52f30abe None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:39.260424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f884b-b521-4c2c-a0d1-cb0f52f30abe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:39.261842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f884b-b521-4c2c-a0d1-cb0f52f30abe None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:39.270426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 391/775] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Jul 6 20:18:39 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:39.321718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5d815-d451-4b4a-9fc1-e45d8924d97b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:39.361748 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c85950-2bc5-413c-9031-287dd9703bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:39.363057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c85950-2bc5-413c-9031-287dd9703bfb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:39.363553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c85950-2bc5-413c-9031-287dd9703bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:39.364016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c85950-2bc5-413c-9031-287dd9703bfb None admin] PATH_INFO: `/v3/services/network` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:39.365028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c85950-2bc5-413c-9031-287dd9703bfb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:39.366658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c85950-2bc5-413c-9031-287dd9703bfb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-83c85950-2bc5-413c-9031-287dd9703bfb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:39.380296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:39.381443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:18:39.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:39.385670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 385/776] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:39 2022] GET /identity/v3/services/network => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:39.394186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f884b-b521-4c2c-a0d1-cb0f52f30abe None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:39.500988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:39.541596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f884b-b521-4c2c-a0d1-cb0f52f30abe None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:39.583274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ff74c-5153-430f-b320-90e86189e479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:39.584007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ff74c-5153-430f-b320-90e86189e479 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:39.584289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ff74c-5153-430f-b320-90e86189e479 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:39.584561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ff74c-5153-430f-b320-90e86189e479 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:39.585317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ff74c-5153-430f-b320-90e86189e479 None admin] RBAC: Adding query filter params (name=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:39.585624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ff74c-5153-430f-b320-90e86189e479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:39.587036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ff74c-5153-430f-b320-90e86189e479 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:39.596675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 392/777] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:18:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:39.598064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c85950-2bc5-413c-9031-287dd9703bfb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:39.725990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:39.729900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c85950-2bc5-413c-9031-287dd9703bfb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:39.780778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27131ac6-113b-46a6-a60b-fa4d4106ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:39.781489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27131ac6-113b-46a6-a60b-fa4d4106ef52 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:39.781765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27131ac6-113b-46a6-a60b-fa4d4106ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:39.782032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27131ac6-113b-46a6-a60b-fa4d4106ef52 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:39.782750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27131ac6-113b-46a6-a60b-fa4d4106ef52 None admin] RBAC: Adding query filter params (type=network) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:39.783050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27131ac6-113b-46a6-a60b-fa4d4106ef52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:39.784420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27131ac6-113b-46a6-a60b-fa4d4106ef52 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:39.790046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 386/778] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:18:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:39.796115 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ff74c-5153-430f-b320-90e86189e479 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:39.924798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceacbff-2245-47dc-8d8e-349eea98b871 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:39.925489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceacbff-2245-47dc-8d8e-349eea98b871 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:39.925975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceacbff-2245-47dc-8d8e-349eea98b871 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:39.927953 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 387/779] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:39.933351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757398-70e0-4249-99db-e5faec83e231 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:39.933872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757398-70e0-4249-99db-e5faec83e231 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:39.934352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757398-70e0-4249-99db-e5faec83e231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:39.958300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ff74c-5153-430f-b320-90e86189e479 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:39.960819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ed757398-70e0-4249-99db-e5faec83e231 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:39.962056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ed757398-70e0-4249-99db-e5faec83e231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:40.017114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:40.027291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068e654-e209-4d5b-9bce-0f3c4c0c01f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:40.027986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068e654-e209-4d5b-9bce-0f3c4c0c01f5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:40.028269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068e654-e209-4d5b-9bce-0f3c4c0c01f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:40.028549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068e654-e209-4d5b-9bce-0f3c4c0c01f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:40.029390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068e654-e209-4d5b-9bce-0f3c4c0c01f5 None admin] RBAC: Adding query filter params (interface=public, service_id=5dc98ec6f95848cf9b0be76fe56a6ceb, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:40.029707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068e654-e209-4d5b-9bce-0f3c4c0c01f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:40.031102 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068e654-e209-4d5b-9bce-0f3c4c0c01f5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:40.050327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 393/780] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Jul 6 20:18:39 2022] GET /identity/v3/endpoints?service_id=5dc98ec6f95848cf9b0be76fe56a6ceb&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:40.056162 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068e654-e209-4d5b-9bce-0f3c4c0c01f5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:40.077676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 388/781] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:18:40.079108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135a6c-7e55-4474-84d7-8685ff4910ef None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:40.079394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135a6c-7e55-4474-84d7-8685ff4910ef None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:40.079670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135a6c-7e55-4474-84d7-8685ff4910ef None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:40.081229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 389/782] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:40.090995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba03ec-7797-4d2b-baae-5c4f28cdeda7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:40.091564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba03ec-7797-4d2b-baae-5c4f28cdeda7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:40.091925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba03ec-7797-4d2b-baae-5c4f28cdeda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:40.117288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f2ba03ec-7797-4d2b-baae-5c4f28cdeda7 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:40.119247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f2ba03ec-7797-4d2b-baae-5c4f28cdeda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:40.189039 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068e654-e209-4d5b-9bce-0f3c4c0c01f5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:40.209085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 390/783] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:18:40.209999 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba03ec-7797-4d2b-baae-5c4f28cdeda7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:40.229526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f181369-681c-4301-bfbe-5171cf21202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:40.230601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f181369-681c-4301-bfbe-5171cf21202b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:40.231089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f181369-681c-4301-bfbe-5171cf21202b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:40.231557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f181369-681c-4301-bfbe-5171cf21202b None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:40.233043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f181369-681c-4301-bfbe-5171cf21202b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:40.235515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f181369-681c-4301-bfbe-5171cf21202b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:40.243213 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 394/784] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Jul 6 20:18:40 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:40.244263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f181369-681c-4301-bfbe-5171cf21202b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:40.251521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:40.327075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:40.378538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f181369-681c-4301-bfbe-5171cf21202b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:40.431217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a409d6-da25-4ab0-8917-4ed932876fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:40.432092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a409d6-da25-4ab0-8917-4ed932876fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:40.432394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a409d6-da25-4ab0-8917-4ed932876fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:40.432690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a409d6-da25-4ab0-8917-4ed932876fd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:40.436840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba03ec-7797-4d2b-baae-5c4f28cdeda7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:40.447022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a409d6-da25-4ab0-8917-4ed932876fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-30a409d6-da25-4ab0-8917-4ed932876fd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:40.456790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:40.457882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:40.458781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:40.462731 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 395/785] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:40.469029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a409d6-da25-4ab0-8917-4ed932876fd2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:40.480411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12330e83-eb72-45d3-a699-3c939987816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:40.481595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12330e83-eb72-45d3-a699-3c939987816b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:40.481945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12330e83-eb72-45d3-a699-3c939987816b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:40.482283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12330e83-eb72-45d3-a699-3c939987816b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:40.493382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12330e83-eb72-45d3-a699-3c939987816b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-12330e83-eb72-45d3-a699-3c939987816b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:40.502614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:40.503615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:40.504901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 391/786] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:40.510944 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12330e83-eb72-45d3-a699-3c939987816b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:40.589297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a409d6-da25-4ab0-8917-4ed932876fd2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:40.600153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:40.617682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:40.622968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12330e83-eb72-45d3-a699-3c939987816b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:40.635649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c60ff-f19b-4843-bb67-1dccc8153e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:40.636768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c60ff-f19b-4843-bb67-1dccc8153e21 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:40.637295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c60ff-f19b-4843-bb67-1dccc8153e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:40.637766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c60ff-f19b-4843-bb67-1dccc8153e21 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:40.638743 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c60ff-f19b-4843-bb67-1dccc8153e21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:40.639384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c60ff-f19b-4843-bb67-1dccc8153e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:40.642670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c60ff-f19b-4843-bb67-1dccc8153e21 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:40.656887 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 396/787] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:40.658544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c60ff-f19b-4843-bb67-1dccc8153e21 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:40.665272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86586a1f-e7a1-41ba-a892-ca50863f15b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:40.665995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86586a1f-e7a1-41ba-a892-ca50863f15b1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:40.666272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86586a1f-e7a1-41ba-a892-ca50863f15b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:40.666549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86586a1f-e7a1-41ba-a892-ca50863f15b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:40.667307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86586a1f-e7a1-41ba-a892-ca50863f15b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:40.667608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86586a1f-e7a1-41ba-a892-ca50863f15b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:40.668996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86586a1f-e7a1-41ba-a892-ca50863f15b1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:40.678373 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 392/788] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:40.683897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86586a1f-e7a1-41ba-a892-ca50863f15b1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:40.788986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86586a1f-e7a1-41ba-a892-ca50863f15b1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:40.790478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c60ff-f19b-4843-bb67-1dccc8153e21 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:40.842716 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c51bd-6680-4029-8586-64077812f2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:40.844857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c51bd-6680-4029-8586-64077812f2cb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:40.845993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c51bd-6680-4029-8586-64077812f2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:40.847004 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c51bd-6680-4029-8586-64077812f2cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:40.859809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241587e-7394-4bf8-9777-ad33e0cd7f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:40.861409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241587e-7394-4bf8-9777-ad33e0cd7f97 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:40.863015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241587e-7394-4bf8-9777-ad33e0cd7f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:40.865246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241587e-7394-4bf8-9777-ad33e0cd7f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:40.869234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c51bd-6680-4029-8586-64077812f2cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:40.872988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c51bd-6680-4029-8586-64077812f2cb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:40.881869 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:40.887689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241587e-7394-4bf8-9777-ad33e0cd7f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:40.889179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241587e-7394-4bf8-9777-ad33e0cd7f97 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5e5c51bd-6680-4029-8586-64077812f2cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:40.904977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:40.905885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:40.906761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:40.906761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:40.906761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:40.906761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5241587e-7394-4bf8-9777-ad33e0cd7f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:40.906988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:40.907831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:40.908725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:40.908725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:40.908725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:40.908725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:40.911357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 393/790] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:40.911468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 397/790] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:40.913764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241587e-7394-4bf8-9777-ad33e0cd7f97 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:40.917342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c51bd-6680-4029-8586-64077812f2cb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:40.954942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:41.020007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241587e-7394-4bf8-9777-ad33e0cd7f97 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:41.043435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c51bd-6680-4029-8586-64077812f2cb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:41.055736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6106c4c-dd22-4343-8d48-df07d1694730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:41.056534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6106c4c-dd22-4343-8d48-df07d1694730 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:41.056815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6106c4c-dd22-4343-8d48-df07d1694730 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:41.057128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6106c4c-dd22-4343-8d48-df07d1694730 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:41.058031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6106c4c-dd22-4343-8d48-df07d1694730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:41.058704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6106c4c-dd22-4343-8d48-df07d1694730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:41.060384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6106c4c-dd22-4343-8d48-df07d1694730 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:41.078277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 398/791] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:41.079619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6106c4c-dd22-4343-8d48-df07d1694730 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:41.165751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6abb75-6744-4145-9731-c7a802b93d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:41.166411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6abb75-6744-4145-9731-c7a802b93d61 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:41.166615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6abb75-6744-4145-9731-c7a802b93d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:41.166884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6abb75-6744-4145-9731-c7a802b93d61 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:41.167617 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6abb75-6744-4145-9731-c7a802b93d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:41.167916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6abb75-6744-4145-9731-c7a802b93d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:41.169325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6abb75-6744-4145-9731-c7a802b93d61 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:41.178832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:41.185828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6106c4c-dd22-4343-8d48-df07d1694730 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:41.201820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 394/792] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:41.210582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6abb75-6744-4145-9731-c7a802b93d61 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:41.245432 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4495f-7a3b-4468-9fa9-b004cd7fcba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:41.246258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4495f-7a3b-4468-9fa9-b004cd7fcba5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:41.246534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4495f-7a3b-4468-9fa9-b004cd7fcba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:41.246802 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4495f-7a3b-4468-9fa9-b004cd7fcba5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:41.258089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4495f-7a3b-4468-9fa9-b004cd7fcba5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:41.259556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4495f-7a3b-4468-9fa9-b004cd7fcba5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1aa4495f-7a3b-4468-9fa9-b004cd7fcba5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:41.283834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:41.284849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:41.285826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:41.285826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:41.285826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:41.285826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:41.285826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:41.285826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:41.285826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:41.285826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:41.285826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:41.285826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:41.290304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 399/793] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jul 6 20:18:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:41.297569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4495f-7a3b-4468-9fa9-b004cd7fcba5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:41.323582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:41.412469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4495f-7a3b-4468-9fa9-b004cd7fcba5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:41.424715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6abb75-6744-4145-9731-c7a802b93d61 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:41.447272 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c1e1b-a1a8-48b1-82ce-d5110412689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:41.448001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c1e1b-a1a8-48b1-82ce-d5110412689f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:41.448213 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c1e1b-a1a8-48b1-82ce-d5110412689f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:41.448481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c1e1b-a1a8-48b1-82ce-d5110412689f None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:41.450285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c1e1b-a1a8-48b1-82ce-d5110412689f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:41.450285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c1e1b-a1a8-48b1-82ce-d5110412689f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:41.451079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c1e1b-a1a8-48b1-82ce-d5110412689f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:41.468906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 400/794] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Jul 6 20:18:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:41.475407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c1e1b-a1a8-48b1-82ce-d5110412689f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:41.485848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33f30d-2b0a-4c3a-951f-d480a21737b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:41.492979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33f30d-2b0a-4c3a-951f-d480a21737b6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:41.493121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:41.493688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33f30d-2b0a-4c3a-951f-d480a21737b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:41.494165 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33f30d-2b0a-4c3a-951f-d480a21737b6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:41.502296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33f30d-2b0a-4c3a-951f-d480a21737b6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:41.512979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33f30d-2b0a-4c3a-951f-d480a21737b6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-cd33f30d-2b0a-4c3a-951f-d480a21737b6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:41.533271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:41.534235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:41.535158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:41.535158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:41.535158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:41.535158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:41.535158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:41.535158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:41.535158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:41.535158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:41.535158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:41.535158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:41.545287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 395/795] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:41.546464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33f30d-2b0a-4c3a-951f-d480a21737b6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:41.576691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c1e1b-a1a8-48b1-82ce-d5110412689f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:41.613037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc926b9-b3c3-4584-83ce-c32feb36d1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:41.613896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc926b9-b3c3-4584-83ce-c32feb36d1ad None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:41.614178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc926b9-b3c3-4584-83ce-c32feb36d1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:41.614452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc926b9-b3c3-4584-83ce-c32feb36d1ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:41.626292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc926b9-b3c3-4584-83ce-c32feb36d1ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:41.627580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc926b9-b3c3-4584-83ce-c32feb36d1ad None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9bc926b9-b3c3-4584-83ce-c32feb36d1ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:41.647697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:41.648641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:41.649585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:41.649585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:41.649585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:41.649585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:41.649585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 401/796] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:41.650472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b43ea-f07d-4fb9-a90f-6f2bad06608e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:41.650679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b43ea-f07d-4fb9-a90f-6f2bad06608e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:41.651100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b43ea-f07d-4fb9-a90f-6f2bad06608e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:41.652363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 402/797] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:41.657286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b43ea-f07d-4fb9-a90f-6f2bad06608e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:41.680310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33f30d-2b0a-4c3a-951f-d480a21737b6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:41.699947 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:41.722821 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1fe0a-c4ba-4b97-ab35-004b4625f253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:41.724017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1fe0a-c4ba-4b97-ab35-004b4625f253 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:41.724347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1fe0a-c4ba-4b97-ab35-004b4625f253 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:41.724625 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1fe0a-c4ba-4b97-ab35-004b4625f253 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:41.725533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1fe0a-c4ba-4b97-ab35-004b4625f253 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:41.726327 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1fe0a-c4ba-4b97-ab35-004b4625f253 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:41.728040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1fe0a-c4ba-4b97-ab35-004b4625f253 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:41.736022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:41.759149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 396/798] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jul 6 20:18:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:41.759149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c188b-5d47-484d-9235-e502b2790903 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:41.759149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c188b-5d47-484d-9235-e502b2790903 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:41.759149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c188b-5d47-484d-9235-e502b2790903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:41.779676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-714c188b-5d47-484d-9235-e502b2790903 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:41.781461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-714c188b-5d47-484d-9235-e502b2790903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:41.788431 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b43ea-f07d-4fb9-a90f-6f2bad06608e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:41.832802 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf20ed4-1421-4f50-a9d2-775e24622997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:41.833565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf20ed4-1421-4f50-a9d2-775e24622997 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:41.833901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf20ed4-1421-4f50-a9d2-775e24622997 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:41.834173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf20ed4-1421-4f50-a9d2-775e24622997 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:41.834947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf20ed4-1421-4f50-a9d2-775e24622997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:41.835254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf20ed4-1421-4f50-a9d2-775e24622997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:41.836652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf20ed4-1421-4f50-a9d2-775e24622997 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:41.849473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 403/799] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:41.850453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf20ed4-1421-4f50-a9d2-775e24622997 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:41.865798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 397/800] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:41.866979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c188b-5d47-484d-9235-e502b2790903 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:41.967769 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c188b-5d47-484d-9235-e502b2790903 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:41.975972 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:41.980354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf20ed4-1421-4f50-a9d2-775e24622997 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:42.004174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbb3b5-236a-4fbf-9f7e-90d862cf2987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:42.004859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:42.005058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbb3b5-236a-4fbf-9f7e-90d862cf2987 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.005320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbb3b5-236a-4fbf-9f7e-90d862cf2987 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.005651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbb3b5-236a-4fbf-9f7e-90d862cf2987 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.013576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbb3b5-236a-4fbf-9f7e-90d862cf2987 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:42.015005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbb3b5-236a-4fbf-9f7e-90d862cf2987 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:42.017668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3402ca-26ba-4e02-b5ff-ac9dd247ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:42.018569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3402ca-26ba-4e02-b5ff-ac9dd247ca02 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.018898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3402ca-26ba-4e02-b5ff-ac9dd247ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.019176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3402ca-26ba-4e02-b5ff-ac9dd247ca02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-58dbb3b5-236a-4fbf-9f7e-90d862cf2987 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:42.030642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:42.031682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:42.032596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:42.032596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:42.032596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:42.032596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:42.032596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:42.032596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:42.032596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:42.032596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:42.033687 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 398/801] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:42.033778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3402ca-26ba-4e02-b5ff-ac9dd247ca02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:42.033861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbb3b5-236a-4fbf-9f7e-90d862cf2987 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:42.034842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3402ca-26ba-4e02-b5ff-ac9dd247ca02 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-df3402ca-26ba-4e02-b5ff-ac9dd247ca02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:42.062015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:42.063013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:42.063914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:42.063914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:42.063914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:42.063914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:42.069357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 404/802] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:42.069357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e27a-6b30-4de4-a95e-b041d7b163a9 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.069357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e27a-6b30-4de4-a95e-b041d7b163a9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.069357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e27a-6b30-4de4-a95e-b041d7b163a9 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.069357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 405/803] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:42.069667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519e27a-6b30-4de4-a95e-b041d7b163a9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:42.144776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbb3b5-236a-4fbf-9f7e-90d862cf2987 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:42.182798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034bda2-bfe6-4fc1-b080-37a512cafe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:42.183790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034bda2-bfe6-4fc1-b080-37a512cafe56 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.184140 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034bda2-bfe6-4fc1-b080-37a512cafe56 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.184481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034bda2-bfe6-4fc1-b080-37a512cafe56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.186622 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519e27a-6b30-4de4-a95e-b041d7b163a9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:42.195526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034bda2-bfe6-4fc1-b080-37a512cafe56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2034bda2-bfe6-4fc1-b080-37a512cafe56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:42.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:42.204077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:42.204920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 399/804] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:42.206296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034bda2-bfe6-4fc1-b080-37a512cafe56 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:42.231637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba52dcb-ab13-48eb-b5f1-e1f8eb401ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:42.232233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba52dcb-ab13-48eb-b5f1-e1f8eb401ede None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.232511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba52dcb-ab13-48eb-b5f1-e1f8eb401ede None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.232780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba52dcb-ab13-48eb-b5f1-e1f8eb401ede None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.233610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba52dcb-ab13-48eb-b5f1-e1f8eb401ede None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:42.233915 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba52dcb-ab13-48eb-b5f1-e1f8eb401ede None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:42.235525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba52dcb-ab13-48eb-b5f1-e1f8eb401ede None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:42.235967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:42.253747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 406/805] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:42.253747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708fa9-7620-41c4-ab00-a62a800ca09f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.253747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708fa9-7620-41c4-ab00-a62a800ca09f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.253747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708fa9-7620-41c4-ab00-a62a800ca09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.271052 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a1708fa9-7620-41c4-ab00-a62a800ca09f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:42.272258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a1708fa9-7620-41c4-ab00-a62a800ca09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:42.303360 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:42.317818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034bda2-bfe6-4fc1-b080-37a512cafe56 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:42.347068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 407/806] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:42.348324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1708fa9-7620-41c4-ab00-a62a800ca09f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:42.360646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce54f-15b0-40fa-a98d-7781c8d8d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:42.361350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce54f-15b0-40fa-a98d-7781c8d8d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.361631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce54f-15b0-40fa-a98d-7781c8d8d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.361908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce54f-15b0-40fa-a98d-7781c8d8d8c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.362644 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce54f-15b0-40fa-a98d-7781c8d8d8c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:42.362951 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce54f-15b0-40fa-a98d-7781c8d8d8c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:42.364325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce54f-15b0-40fa-a98d-7781c8d8d8c1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:42.377786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 400/807] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:42.378667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce54f-15b0-40fa-a98d-7781c8d8d8c1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:42.466863 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1708fa9-7620-41c4-ab00-a62a800ca09f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:42.471227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:42.488940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce54f-15b0-40fa-a98d-7781c8d8d8c1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:42.503401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa3739-4fa1-458c-a77f-e02e711c87fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:42.504086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa3739-4fa1-458c-a77f-e02e711c87fb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.504372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa3739-4fa1-458c-a77f-e02e711c87fb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.504648 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa3739-4fa1-458c-a77f-e02e711c87fb None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.505515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa3739-4fa1-458c-a77f-e02e711c87fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:42.505825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa3739-4fa1-458c-a77f-e02e711c87fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:42.507516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa3739-4fa1-458c-a77f-e02e711c87fb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:42.516453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 408/808] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:42.517051 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa3739-4fa1-458c-a77f-e02e711c87fb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:42.529366 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f443-3f29-4669-a6c4-2ee0cdc2eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:42.531162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f443-3f29-4669-a6c4-2ee0cdc2eb90 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.531661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f443-3f29-4669-a6c4-2ee0cdc2eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.532583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f443-3f29-4669-a6c4-2ee0cdc2eb90 None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/d869f947e5b14979b7f44aa19be9ae50/roles/b464352c183141f4a1be0d9764ea4105` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.551140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:42.551942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f443-3f29-4669-a6c4-2ee0cdc2eb90 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=d869f947e5b14979b7f44aa19be9ae50, role_id=b464352c183141f4a1be0d9764ea4105)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:42.553724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f443-3f29-4669-a6c4-2ee0cdc2eb90 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:42.577006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 401/809] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:18:42 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/d869f947e5b14979b7f44aa19be9ae50/roles/b464352c183141f4a1be0d9764ea4105 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:18:42.577006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f443-3f29-4669-a6c4-2ee0cdc2eb90 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:42.633348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa3739-4fa1-458c-a77f-e02e711c87fb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:42.674061 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50cac1-6c19-4f40-a7ba-48634c7c058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:42.675371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50cac1-6c19-4f40-a7ba-48634c7c058e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.675883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50cac1-6c19-4f40-a7ba-48634c7c058e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.676412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50cac1-6c19-4f40-a7ba-48634c7c058e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.677138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50cac1-6c19-4f40-a7ba-48634c7c058e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:42.678792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50cac1-6c19-4f40-a7ba-48634c7c058e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0f50cac1-6c19-4f40-a7ba-48634c7c058e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:42.693185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:42.694347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:42.695208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 409/810] 10.222.0.30 () {56 vars in 1129 bytes} [Wed Jul 6 20:18:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:42.696058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50cac1-6c19-4f40-a7ba-48634c7c058e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:42.720475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f443-3f29-4669-a6c4-2ee0cdc2eb90 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:42.763226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c8fa2-00f7-4c26-ad05-d3a84157b99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:42.763920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c8fa2-00f7-4c26-ad05-d3a84157b99a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.764228 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c8fa2-00f7-4c26-ad05-d3a84157b99a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.764462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c8fa2-00f7-4c26-ad05-d3a84157b99a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.767438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:42.773086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c8fa2-00f7-4c26-ad05-d3a84157b99a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:42.775726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c8fa2-00f7-4c26-ad05-d3a84157b99a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-da0c8fa2-00f7-4c26-ad05-d3a84157b99a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:42.790681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:42.791604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:42.796103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:42.796103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:42.796103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:42.796103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:42.796103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:42.796103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:42.796103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:42.796103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:42.796103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 402/811] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:42.796103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596af3a-728e-40a8-a1e1-140ccc124073 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.796103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596af3a-728e-40a8-a1e1-140ccc124073 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.797382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596af3a-728e-40a8-a1e1-140ccc124073 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.797382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 403/812] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:42.797382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596af3a-728e-40a8-a1e1-140ccc124073 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:42.817045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:42.827178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50cac1-6c19-4f40-a7ba-48634c7c058e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:42.861589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f2f66-2133-4d8a-a8cc-52f172159341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:42.862412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2f66-2133-4d8a-a8cc-52f172159341 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.862687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2f66-2133-4d8a-a8cc-52f172159341 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.862965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2f66-2133-4d8a-a8cc-52f172159341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.874014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f2f66-2133-4d8a-a8cc-52f172159341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:42.875514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f2f66-2133-4d8a-a8cc-52f172159341 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-222f2f66-2133-4d8a-a8cc-52f172159341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:42.894885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:42.895853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:42.901877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:42.901877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:42.901877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:42.901877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:42.901877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 410/813] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:42.901877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284993e7-f148-45b8-9095-daa94d7e3e82 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.901877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284993e7-f148-45b8-9095-daa94d7e3e82 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.901877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284993e7-f148-45b8-9095-daa94d7e3e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.917770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-284993e7-f148-45b8-9095-daa94d7e3e82 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:42.918995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-284993e7-f148-45b8-9095-daa94d7e3e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:42.919792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596af3a-728e-40a8-a1e1-140ccc124073 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:42.954904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54cdfa-9031-4430-a828-d401b33310b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:42.955548 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54cdfa-9031-4430-a828-d401b33310b0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:42.955840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54cdfa-9031-4430-a828-d401b33310b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:42.956110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54cdfa-9031-4430-a828-d401b33310b0 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:42.956847 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54cdfa-9031-4430-a828-d401b33310b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:42.957190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54cdfa-9031-4430-a828-d401b33310b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:42.958655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54cdfa-9031-4430-a828-d401b33310b0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:42.963732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 404/814] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jul 6 20:18:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:42.964557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54cdfa-9031-4430-a828-d401b33310b0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:43.000622 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 411/815] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:43.001876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284993e7-f148-45b8-9095-daa94d7e3e82 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:43.027746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:43.073153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54cdfa-9031-4430-a828-d401b33310b0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:43.088898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:43.111027 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfe7b8-bbf4-4d6a-9bb3-da3bbae5b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:43.111694 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfe7b8-bbf4-4d6a-9bb3-da3bbae5b700 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:43.111969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfe7b8-bbf4-4d6a-9bb3-da3bbae5b700 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:43.112236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfe7b8-bbf4-4d6a-9bb3-da3bbae5b700 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:43.113232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfe7b8-bbf4-4d6a-9bb3-da3bbae5b700 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:43.113643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfe7b8-bbf4-4d6a-9bb3-da3bbae5b700 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:43.115141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfe7b8-bbf4-4d6a-9bb3-da3bbae5b700 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:43.116539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284993e7-f148-45b8-9095-daa94d7e3e82 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:43.133005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 405/816] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:43.133005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfe7b8-bbf4-4d6a-9bb3-da3bbae5b700 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:43.159548 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4ca7d-ac25-44d9-baa2-dc493bffb276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:43.160237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4ca7d-ac25-44d9-baa2-dc493bffb276 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:43.160516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4ca7d-ac25-44d9-baa2-dc493bffb276 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:43.160789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4ca7d-ac25-44d9-baa2-dc493bffb276 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:43.161568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4ca7d-ac25-44d9-baa2-dc493bffb276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:43.161878 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4ca7d-ac25-44d9-baa2-dc493bffb276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:43.163291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4ca7d-ac25-44d9-baa2-dc493bffb276 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:43.175327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 412/817] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:43.180599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4ca7d-ac25-44d9-baa2-dc493bffb276 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:43.239918 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfe7b8-bbf4-4d6a-9bb3-da3bbae5b700 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:43.260463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:43.278849 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c99191-6c8e-4e38-bc15-3967be2a0fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:43.279461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c99191-6c8e-4e38-bc15-3967be2a0fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:43.279746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c99191-6c8e-4e38-bc15-3967be2a0fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:43.280021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c99191-6c8e-4e38-bc15-3967be2a0fe3 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:43.280737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c99191-6c8e-4e38-bc15-3967be2a0fe3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:43.281069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c99191-6c8e-4e38-bc15-3967be2a0fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:43.282452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c99191-6c8e-4e38-bc15-3967be2a0fe3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:43.287967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 406/818] 10.222.0.30 () {56 vars in 1124 bytes} [Wed Jul 6 20:18:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:43.288626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c99191-6c8e-4e38-bc15-3967be2a0fe3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:43.293997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4ca7d-ac25-44d9-baa2-dc493bffb276 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:43.330721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94786b-84d0-44b3-b8a8-5057bf4730f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:43.331520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94786b-84d0-44b3-b8a8-5057bf4730f5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:43.331797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94786b-84d0-44b3-b8a8-5057bf4730f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:43.332065 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94786b-84d0-44b3-b8a8-5057bf4730f5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:43.332733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94786b-84d0-44b3-b8a8-5057bf4730f5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:43.334189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94786b-84d0-44b3-b8a8-5057bf4730f5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:43.337213 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0b94786b-84d0-44b3-b8a8-5057bf4730f5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:43.347295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:43.348497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:18:43.349629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:43.357527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 413/819] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:43 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:43.357527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94786b-84d0-44b3-b8a8-5057bf4730f5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:43.406008 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c99191-6c8e-4e38-bc15-3967be2a0fe3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:43.440510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9ff22-5b9b-4553-bfb9-cc9adc992168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:43.441721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9ff22-5b9b-4553-bfb9-cc9adc992168 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:43.442001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9ff22-5b9b-4553-bfb9-cc9adc992168 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:43.442270 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9ff22-5b9b-4553-bfb9-cc9adc992168 None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/b11e395dab424f3492f092eb3d5032dd/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:43.444328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9ff22-5b9b-4553-bfb9-cc9adc992168 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=b11e395dab424f3492f092eb3d5032dd, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:43.445824 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9ff22-5b9b-4553-bfb9-cc9adc992168 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:43.459881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 407/820] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:18:43 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/b11e395dab424f3492f092eb3d5032dd/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:18:43.469262 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9ff22-5b9b-4553-bfb9-cc9adc992168 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:43.469354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94786b-84d0-44b3-b8a8-5057bf4730f5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:43.513115 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2db244-2096-495c-a628-7ed2abd33046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:43.513951 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db244-2096-495c-a628-7ed2abd33046 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:43.514231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db244-2096-495c-a628-7ed2abd33046 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:43.514503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db244-2096-495c-a628-7ed2abd33046 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:43.523770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2db244-2096-495c-a628-7ed2abd33046 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:43.525365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2db244-2096-495c-a628-7ed2abd33046 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:43.536846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5f2db244-2096-495c-a628-7ed2abd33046 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:43.543546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:43.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:43.545980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:43.545980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:43.545980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:43.545980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:43.545980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:43.545980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:43.545980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:43.545980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:43.545980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:18:43.545980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:43.545980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 414/821] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Jul 6 20:18:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:43.546566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2db244-2096-495c-a628-7ed2abd33046 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:43.612978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:43.620918 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9ff22-5b9b-4553-bfb9-cc9adc992168 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:43.660158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2db244-2096-495c-a628-7ed2abd33046 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:43.660740 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558c2c0-d192-4216-8c03-9dfd535f0646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:43.661769 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558c2c0-d192-4216-8c03-9dfd535f0646 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:43.662196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558c2c0-d192-4216-8c03-9dfd535f0646 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:43.662711 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558c2c0-d192-4216-8c03-9dfd535f0646 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:43.663981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558c2c0-d192-4216-8c03-9dfd535f0646 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:43.665488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558c2c0-d192-4216-8c03-9dfd535f0646 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:43.698944 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 408/822] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Jul 6 20:18:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:43.700935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558c2c0-d192-4216-8c03-9dfd535f0646 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:43.727134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a7b41-0190-4fe0-8241-99e481f1e66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:43.727839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7b41-0190-4fe0-8241-99e481f1e66e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:43.728123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7b41-0190-4fe0-8241-99e481f1e66e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:43.728395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7b41-0190-4fe0-8241-99e481f1e66e None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:43.729180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a7b41-0190-4fe0-8241-99e481f1e66e None admin] RBAC: Adding query filter params (name=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:43.729493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a7b41-0190-4fe0-8241-99e481f1e66e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:43.733543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a7b41-0190-4fe0-8241-99e481f1e66e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:43.743504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 415/823] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:18:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:43.750863 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a7b41-0190-4fe0-8241-99e481f1e66e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:43.907847 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a7b41-0190-4fe0-8241-99e481f1e66e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:43.932438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:43.949182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:43.954024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded2a11-59ad-44de-922c-cab9b7e2b344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:43.954526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558c2c0-d192-4216-8c03-9dfd535f0646 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:43.955092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded2a11-59ad-44de-922c-cab9b7e2b344 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:43.955416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded2a11-59ad-44de-922c-cab9b7e2b344 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:43.955702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded2a11-59ad-44de-922c-cab9b7e2b344 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:43.956428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded2a11-59ad-44de-922c-cab9b7e2b344 None admin] RBAC: Adding query filter params (type=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:43.956778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded2a11-59ad-44de-922c-cab9b7e2b344 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:43.958987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded2a11-59ad-44de-922c-cab9b7e2b344 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:43.966972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 416/824] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:18:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:43.973468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded2a11-59ad-44de-922c-cab9b7e2b344 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:44.002503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007c0d-7757-4e59-b063-1a93e13dbc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:44.003535 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007c0d-7757-4e59-b063-1a93e13dbc92 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:44.004009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007c0d-7757-4e59-b063-1a93e13dbc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:44.004858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007c0d-7757-4e59-b063-1a93e13dbc92 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:44.006016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9007c0d-7757-4e59-b063-1a93e13dbc92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:44.006841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9007c0d-7757-4e59-b063-1a93e13dbc92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:44.008611 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9007c0d-7757-4e59-b063-1a93e13dbc92 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:44.041156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 409/825] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jul 6 20:18:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:44.044600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007c0d-7757-4e59-b063-1a93e13dbc92 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:44.106486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded2a11-59ad-44de-922c-cab9b7e2b344 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:44.154200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f0557-177c-4668-ab6d-36429dfe36cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:44.155128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f0557-177c-4668-ab6d-36429dfe36cb None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:44.155557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f0557-177c-4668-ab6d-36429dfe36cb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:44.155996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f0557-177c-4668-ab6d-36429dfe36cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:44.156892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f0557-177c-4668-ab6d-36429dfe36cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:44.158465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f0557-177c-4668-ab6d-36429dfe36cb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:44.198746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 417/826] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Jul 6 20:18:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:44.211768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007c0d-7757-4e59-b063-1a93e13dbc92 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:44.277916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c89a3-79b2-4f10-bfe3-41544c1409be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:44.279336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c89a3-79b2-4f10-bfe3-41544c1409be None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:44.279765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c89a3-79b2-4f10-bfe3-41544c1409be None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:44.280181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c89a3-79b2-4f10-bfe3-41544c1409be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:44.311407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:44.365998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c89a3-79b2-4f10-bfe3-41544c1409be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:44.367418 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c89a3-79b2-4f10-bfe3-41544c1409be None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:44.480576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 410/827] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:18:44.482000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f0557-177c-4668-ab6d-36429dfe36cb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:44.524346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:44.590898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f0557-177c-4668-ab6d-36429dfe36cb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:44.624751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b972b9-94cf-46d0-9fff-1ef02d5b6db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:44.625513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b972b9-94cf-46d0-9fff-1ef02d5b6db0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:44.625793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b972b9-94cf-46d0-9fff-1ef02d5b6db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:44.626068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b972b9-94cf-46d0-9fff-1ef02d5b6db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:44.641665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b972b9-94cf-46d0-9fff-1ef02d5b6db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:44.643130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b972b9-94cf-46d0-9fff-1ef02d5b6db0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d9b972b9-94cf-46d0-9fff-1ef02d5b6db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:44.664726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:44.665757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:44.666647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:44.666647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:44.666647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:44.666647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:44.670394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 418/828] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:44.672139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c89a3-79b2-4f10-bfe3-41544c1409be None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:44.738431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:44.790383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c89a3-79b2-4f10-bfe3-41544c1409be None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:44.818079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc85ef-65ff-4105-907b-2a133f2c3acd None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:44.818367 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc85ef-65ff-4105-907b-2a133f2c3acd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:44.818645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc85ef-65ff-4105-907b-2a133f2c3acd None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:44.820296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 419/829] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:44.825403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba8702-31e1-4b81-88f0-2ec8a9ad6a17 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:44.825690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba8702-31e1-4b81-88f0-2ec8a9ad6a17 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:44.825972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba8702-31e1-4b81-88f0-2ec8a9ad6a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:44.837664 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43bf9c-adbb-42a5-ad4e-15dabce9da33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:44.838647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43bf9c-adbb-42a5-ad4e-15dabce9da33 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:44.839063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43bf9c-adbb-42a5-ad4e-15dabce9da33 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:44.839479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43bf9c-adbb-42a5-ad4e-15dabce9da33 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:44.840406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43bf9c-adbb-42a5-ad4e-15dabce9da33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:44.840885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43bf9c-adbb-42a5-ad4e-15dabce9da33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:44.842425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43bf9c-adbb-42a5-ad4e-15dabce9da33 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:44.843852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-91ba8702-31e1-4b81-88f0-2ec8a9ad6a17 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:44.845395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-91ba8702-31e1-4b81-88f0-2ec8a9ad6a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:44.855394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 411/830] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:44.863464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43bf9c-adbb-42a5-ad4e-15dabce9da33 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:44.914359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 420/831] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:44.937525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba8702-31e1-4b81-88f0-2ec8a9ad6a17 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:44.963130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:44.983358 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43bf9c-adbb-42a5-ad4e-15dabce9da33 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:45.001932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:45.026589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8942a-cb5e-4180-95dc-91bfdba20d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:45.027485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8942a-cb5e-4180-95dc-91bfdba20d2b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:45.028289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8942a-cb5e-4180-95dc-91bfdba20d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:45.028642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8942a-cb5e-4180-95dc-91bfdba20d2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:45.037987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8942a-cb5e-4180-95dc-91bfdba20d2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:45.040080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8942a-cb5e-4180-95dc-91bfdba20d2b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:45.051533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba8702-31e1-4b81-88f0-2ec8a9ad6a17 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8aa8942a-cb5e-4180-95dc-91bfdba20d2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:45.058545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:45.059603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:45.060700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:45.060700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:45.060700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:45.060700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:45.060700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:45.060700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:45.060700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:45.060700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:45.065101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 412/832] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:45.067400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8942a-cb5e-4180-95dc-91bfdba20d2b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:45.096055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d69975-9d07-4207-b1d4-86e1d7a17d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:45.096870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d69975-9d07-4207-b1d4-86e1d7a17d58 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:45.097183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d69975-9d07-4207-b1d4-86e1d7a17d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:45.097469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d69975-9d07-4207-b1d4-86e1d7a17d58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:45.108679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d69975-9d07-4207-b1d4-86e1d7a17d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-08d69975-9d07-4207-b1d4-86e1d7a17d58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:45.116850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:45.117839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:18:45.118683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:45.123161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 421/833] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:18:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:45.124050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d69975-9d07-4207-b1d4-86e1d7a17d58 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:45.175076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8942a-cb5e-4180-95dc-91bfdba20d2b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:45.211188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c073c-7b50-4937-bb64-a64cac759956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:45.211684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:45.212475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c073c-7b50-4937-bb64-a64cac759956 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:45.212951 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c073c-7b50-4937-bb64-a64cac759956 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:45.213428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c073c-7b50-4937-bb64-a64cac759956 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:45.214421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c073c-7b50-4937-bb64-a64cac759956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:45.215110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c073c-7b50-4937-bb64-a64cac759956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:45.216940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c073c-7b50-4937-bb64-a64cac759956 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:45.229863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 413/834] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:45.237090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d69975-9d07-4207-b1d4-86e1d7a17d58 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:45.237274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c073c-7b50-4937-bb64-a64cac759956 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:45.268679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31015a55-03aa-4a3d-ba70-12d98b1761f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:45.269400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015a55-03aa-4a3d-ba70-12d98b1761f1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:45.269680 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015a55-03aa-4a3d-ba70-12d98b1761f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:45.269959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015a55-03aa-4a3d-ba70-12d98b1761f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:45.270723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31015a55-03aa-4a3d-ba70-12d98b1761f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:45.271099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31015a55-03aa-4a3d-ba70-12d98b1761f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:45.272503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31015a55-03aa-4a3d-ba70-12d98b1761f1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:45.285748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 422/835] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:18:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:45.286722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31015a55-03aa-4a3d-ba70-12d98b1761f1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:45.301318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:45.353441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c073c-7b50-4937-bb64-a64cac759956 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:45.388017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d424f4-92ca-473d-bedf-fbc395c32800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:45.388834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d424f4-92ca-473d-bedf-fbc395c32800 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:45.389277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d424f4-92ca-473d-bedf-fbc395c32800 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:45.389693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d424f4-92ca-473d-bedf-fbc395c32800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:45.390682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d424f4-92ca-473d-bedf-fbc395c32800 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=56ad461f6dc54014a956e5c8a094352c) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:45.391102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d424f4-92ca-473d-bedf-fbc395c32800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:45.392636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d424f4-92ca-473d-bedf-fbc395c32800 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:45.399018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 414/836] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:45 2022] GET /identity/v3/role_assignments?user.id=56ad461f6dc54014a956e5c8a094352c&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:45.417188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31015a55-03aa-4a3d-ba70-12d98b1761f1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:45.457015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af25d0-3b38-408a-9b41-844b7cd80195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:45.457768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af25d0-3b38-408a-9b41-844b7cd80195 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:45.458050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af25d0-3b38-408a-9b41-844b7cd80195 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:45.458367 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af25d0-3b38-408a-9b41-844b7cd80195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:45.470813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af25d0-3b38-408a-9b41-844b7cd80195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:45.472349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af25d0-3b38-408a-9b41-844b7cd80195 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:45.481336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e4af25d0-3b38-408a-9b41-844b7cd80195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:45.494346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:45.495729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:45.497263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:45.497263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:45.497263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:45.497263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:45.497263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 423/837] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:45.501761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d424f4-92ca-473d-bedf-fbc395c32800 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:45.608941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:45.612746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d424f4-92ca-473d-bedf-fbc395c32800 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:45.652145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866808c0-faf3-4edd-80e5-4a928999c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:45.653126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866808c0-faf3-4edd-80e5-4a928999c823 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:45.653568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866808c0-faf3-4edd-80e5-4a928999c823 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:45.653980 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866808c0-faf3-4edd-80e5-4a928999c823 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:45.654851 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866808c0-faf3-4edd-80e5-4a928999c823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:45.655303 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866808c0-faf3-4edd-80e5-4a928999c823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:45.656834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866808c0-faf3-4edd-80e5-4a928999c823 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:45.670126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 415/838] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:45.678711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af25d0-3b38-408a-9b41-844b7cd80195 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:45.686671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e412f-b348-44af-8ed2-14c5dc2f6bcd None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:45.686955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e412f-b348-44af-8ed2-14c5dc2f6bcd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:45.687232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e412f-b348-44af-8ed2-14c5dc2f6bcd None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:45.688897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 416/839] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:45.694114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c27ab-c231-448f-ac79-9eeda2e4f393 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:45.694398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c27ab-c231-448f-ac79-9eeda2e4f393 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:45.694673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c27ab-c231-448f-ac79-9eeda2e4f393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:45.712148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-104c27ab-c231-448f-ac79-9eeda2e4f393 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:45.713367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-104c27ab-c231-448f-ac79-9eeda2e4f393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:45.783385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af25d0-3b38-408a-9b41-844b7cd80195 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:45.802471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 417/840] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:18:45.829566 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c27ab-c231-448f-ac79-9eeda2e4f393 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:45.830508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05dbf-a26d-4f47-a6f5-f1118e7300e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:45.831338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05dbf-a26d-4f47-a6f5-f1118e7300e9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:45.831620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05dbf-a26d-4f47-a6f5-f1118e7300e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:45.831889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05dbf-a26d-4f47-a6f5-f1118e7300e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:45.840493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d05dbf-a26d-4f47-a6f5-f1118e7300e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:45.842068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d05dbf-a26d-4f47-a6f5-f1118e7300e9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b3d05dbf-a26d-4f47-a6f5-f1118e7300e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:45.857875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:45.858828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:45.860398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:45.860398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:45.860398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:45.860398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:45.860398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:45.860398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:45.860398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:45.860398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:45.860398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:45.860398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:45.860398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 424/841] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jul 6 20:18:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:45.864892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05dbf-a26d-4f47-a6f5-f1118e7300e9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:45.935657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:45.944204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:45.959061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c27ab-c231-448f-ac79-9eeda2e4f393 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:45.997926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2603552-1f4a-4755-9002-9eef2993b940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:45.998965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2603552-1f4a-4755-9002-9eef2993b940 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:45.999400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2603552-1f4a-4755-9002-9eef2993b940 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:45.999812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2603552-1f4a-4755-9002-9eef2993b940 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.000833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05dbf-a26d-4f47-a6f5-f1118e7300e9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:46.011310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2603552-1f4a-4755-9002-9eef2993b940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c2603552-1f4a-4755-9002-9eef2993b940 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:46.019131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:46.020095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:18:46.021018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:46.023782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 418/842] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:46.029145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2603552-1f4a-4755-9002-9eef2993b940 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:46.044371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdfc0d-d7a1-4a3b-9804-6db4ad01b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:46.045848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdfc0d-d7a1-4a3b-9804-6db4ad01b920 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.046205 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdfc0d-d7a1-4a3b-9804-6db4ad01b920 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:46.046550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdfc0d-d7a1-4a3b-9804-6db4ad01b920 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.048004 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdfc0d-d7a1-4a3b-9804-6db4ad01b920 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:46.048385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdfc0d-d7a1-4a3b-9804-6db4ad01b920 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:46.050559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdfc0d-d7a1-4a3b-9804-6db4ad01b920 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:46.077860 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 425/843] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Jul 6 20:18:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:46.085968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdfc0d-d7a1-4a3b-9804-6db4ad01b920 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:46.141214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2603552-1f4a-4755-9002-9eef2993b940 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:46.179353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8eae2-ea08-4090-a50a-3a0562eeb8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:46.180141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8eae2-ea08-4090-a50a-3a0562eeb8ef None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.180420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8eae2-ea08-4090-a50a-3a0562eeb8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:46.180709 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8eae2-ea08-4090-a50a-3a0562eeb8ef None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.181496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8eae2-ea08-4090-a50a-3a0562eeb8ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:46.181802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8eae2-ea08-4090-a50a-3a0562eeb8ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:46.183404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8eae2-ea08-4090-a50a-3a0562eeb8ef None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:46.197455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 419/844] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:18:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:46.197455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd9bb7-0418-423b-a733-9ed3d57c70c6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.197455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd9bb7-0418-423b-a733-9ed3d57c70c6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:46.197455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd9bb7-0418-423b-a733-9ed3d57c70c6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.197455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 420/845] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:46.198245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd9bb7-0418-423b-a733-9ed3d57c70c6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:46.206539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdfc0d-d7a1-4a3b-9804-6db4ad01b920 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:46.213237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:46.220269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:46.243340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cfb12-f3d5-4a52-b63b-93454017cbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:46.244006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cfb12-f3d5-4a52-b63b-93454017cbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.244289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cfb12-f3d5-4a52-b63b-93454017cbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:46.244559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cfb12-f3d5-4a52-b63b-93454017cbc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.309654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd9bb7-0418-423b-a733-9ed3d57c70c6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:46.313680 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cfb12-f3d5-4a52-b63b-93454017cbc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:46.315161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cfb12-f3d5-4a52-b63b-93454017cbc4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:46.345522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fa37a-7a7b-41fc-81bf-3ac978630328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:46.346339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa37a-7a7b-41fc-81bf-3ac978630328 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.346883 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa37a-7a7b-41fc-81bf-3ac978630328 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:46.347157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa37a-7a7b-41fc-81bf-3ac978630328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.358133 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fa37a-7a7b-41fc-81bf-3ac978630328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:46.359721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fa37a-7a7b-41fc-81bf-3ac978630328 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ed9fa37a-7a7b-41fc-81bf-3ac978630328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:46.377764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:46.378671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:46.379559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:46.379559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:46.379559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:46.379559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:46.379559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 421/846] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:46.380355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cdb62-3d87-465d-afcb-0cb1d7b30067 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.380635 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cdb62-3d87-465d-afcb-0cb1d7b30067 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:46.380917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cdb62-3d87-465d-afcb-0cb1d7b30067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.398452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8d2cdb62-3d87-465d-afcb-0cb1d7b30067 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:46.399736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8d2cdb62-3d87-465d-afcb-0cb1d7b30067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:46.426582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 426/847] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:18:46.428220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cfb12-f3d5-4a52-b63b-93454017cbc4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:46.445437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:46.465353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:46.484989 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 422/848] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:46.484989 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cdb62-3d87-465d-afcb-0cb1d7b30067 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:46.549567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cfb12-f3d5-4a52-b63b-93454017cbc4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:46.584413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcb21b-0507-4f45-8355-f0a649c755b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:46.585025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcb21b-0507-4f45-8355-f0a649c755b8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.585354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcb21b-0507-4f45-8355-f0a649c755b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:46.585628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcb21b-0507-4f45-8355-f0a649c755b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.586356 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcb21b-0507-4f45-8355-f0a649c755b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:46.586661 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcb21b-0507-4f45-8355-f0a649c755b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:46.588043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcb21b-0507-4f45-8355-f0a649c755b8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:46.588237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cdb62-3d87-465d-afcb-0cb1d7b30067 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:46.600458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 427/849] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:46.601367 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcb21b-0507-4f45-8355-f0a649c755b8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:46.631845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993cf34-3d36-42fa-9e36-22a403e86aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:46.633061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993cf34-3d36-42fa-9e36-22a403e86aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.633509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993cf34-3d36-42fa-9e36-22a403e86aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:46.633914 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993cf34-3d36-42fa-9e36-22a403e86aa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.644856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993cf34-3d36-42fa-9e36-22a403e86aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:46.646741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993cf34-3d36-42fa-9e36-22a403e86aa4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3993cf34-3d36-42fa-9e36-22a403e86aa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:46.666046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:46.667107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:46.668148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:46.668148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:46.668148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:46.668148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:46.668148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 423/850] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:46.668481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993cf34-3d36-42fa-9e36-22a403e86aa4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:46.680113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:46.714108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcb21b-0507-4f45-8355-f0a649c755b8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:46.719077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:46.754490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913b1e5-baeb-4188-9015-64c7dbdb18ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:46.755329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b1e5-baeb-4188-9015-64c7dbdb18ce None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.755674 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b1e5-baeb-4188-9015-64c7dbdb18ce None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:46.755955 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b1e5-baeb-4188-9015-64c7dbdb18ce None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.757036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913b1e5-baeb-4188-9015-64c7dbdb18ce None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:46.758477 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913b1e5-baeb-4188-9015-64c7dbdb18ce None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4913b1e5-baeb-4188-9015-64c7dbdb18ce None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:46.771505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:46.773158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:46.774894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 428/851] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:46.779055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913b1e5-baeb-4188-9015-64c7dbdb18ce None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:46.784508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993cf34-3d36-42fa-9e36-22a403e86aa4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:46.827295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5da4c-27c7-427d-96a1-06065f0697ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:46.828127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5da4c-27c7-427d-96a1-06065f0697ad None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.828396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5da4c-27c7-427d-96a1-06065f0697ad None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:46.828677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5da4c-27c7-427d-96a1-06065f0697ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.836643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5da4c-27c7-427d-96a1-06065f0697ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:46.838103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5da4c-27c7-427d-96a1-06065f0697ad None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1fc5da4c-27c7-427d-96a1-06065f0697ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:46.853095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:46.854021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 424/852] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:18:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:46.855674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5da4c-27c7-427d-96a1-06065f0697ad None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:46.893427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913b1e5-baeb-4188-9015-64c7dbdb18ce None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:46.930823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57c31f-df85-45ad-a711-e6b4b0b9d570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:46.931535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57c31f-df85-45ad-a711-e6b4b0b9d570 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.931811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57c31f-df85-45ad-a711-e6b4b0b9d570 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:46.932127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57c31f-df85-45ad-a711-e6b4b0b9d570 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:46.932850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57c31f-df85-45ad-a711-e6b4b0b9d570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:46.933180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57c31f-df85-45ad-a711-e6b4b0b9d570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:46.934570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57c31f-df85-45ad-a711-e6b4b0b9d570 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:46.937292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:46.952600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 429/853] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:46.952600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57c31f-df85-45ad-a711-e6b4b0b9d570 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:46.963368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5da4c-27c7-427d-96a1-06065f0697ad None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:46.965717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:46.998890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabe172-ee78-40a6-a641-7db86ffc5f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:46.999563 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabe172-ee78-40a6-a641-7db86ffc5f25 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:46.999859 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabe172-ee78-40a6-a641-7db86ffc5f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.000119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabe172-ee78-40a6-a641-7db86ffc5f25 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.000841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabe172-ee78-40a6-a641-7db86ffc5f25 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:47.001192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabe172-ee78-40a6-a641-7db86ffc5f25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:47.002561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabe172-ee78-40a6-a641-7db86ffc5f25 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:47.007580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 425/854] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:47.008366 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabe172-ee78-40a6-a641-7db86ffc5f25 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:47.062053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57c31f-df85-45ad-a711-e6b4b0b9d570 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:47.098543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eac2f5-66d7-4402-9e47-7598aac0e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:47.099410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eac2f5-66d7-4402-9e47-7598aac0e0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:47.099781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eac2f5-66d7-4402-9e47-7598aac0e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.100146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eac2f5-66d7-4402-9e47-7598aac0e0a4 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.101115 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eac2f5-66d7-4402-9e47-7598aac0e0a4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:47.101516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eac2f5-66d7-4402-9e47-7598aac0e0a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:47.103035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eac2f5-66d7-4402-9e47-7598aac0e0a4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:47.110496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabe172-ee78-40a6-a641-7db86ffc5f25 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:47.121249 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 430/855] 10.222.0.30 () {56 vars in 1135 bytes} [Wed Jul 6 20:18:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:47.122203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eac2f5-66d7-4402-9e47-7598aac0e0a4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:47.154632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6bc78-f9cd-4a6f-a297-5e0be639a148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:47.155610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6bc78-f9cd-4a6f-a297-5e0be639a148 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:47.155971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6bc78-f9cd-4a6f-a297-5e0be639a148 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.156332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6bc78-f9cd-4a6f-a297-5e0be639a148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.163771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6bc78-f9cd-4a6f-a297-5e0be639a148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:47.165379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6bc78-f9cd-4a6f-a297-5e0be639a148 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c7d6bc78-f9cd-4a6f-a297-5e0be639a148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:47.179907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:47.181015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:47.182125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:47.182125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:47.182125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:47.182125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:47.182125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:47.182125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:47.182125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:47.182125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:47.188163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 426/856] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:47.188163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6bc78-f9cd-4a6f-a297-5e0be639a148 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:47.189620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:47.214727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:47.236163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eac2f5-66d7-4402-9e47-7598aac0e0a4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:47.273842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1278a2c-fde5-4bd0-8a6e-ceb6f2176470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:47.274802 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1278a2c-fde5-4bd0-8a6e-ceb6f2176470 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:47.275079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1278a2c-fde5-4bd0-8a6e-ceb6f2176470 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.275346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1278a2c-fde5-4bd0-8a6e-ceb6f2176470 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.276055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1278a2c-fde5-4bd0-8a6e-ceb6f2176470 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:47.276357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1278a2c-fde5-4bd0-8a6e-ceb6f2176470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:47.278191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1278a2c-fde5-4bd0-8a6e-ceb6f2176470 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:47.289304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 431/857] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:47.289304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1278a2c-fde5-4bd0-8a6e-ceb6f2176470 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:47.297033 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6bc78-f9cd-4a6f-a297-5e0be639a148 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:47.335077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f069a7-d4f9-4c80-9109-36bafcd60dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:47.335838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f069a7-d4f9-4c80-9109-36bafcd60dbf None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:47.336082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f069a7-d4f9-4c80-9109-36bafcd60dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.336407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f069a7-d4f9-4c80-9109-36bafcd60dbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.420048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1278a2c-fde5-4bd0-8a6e-ceb6f2176470 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:47.428868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f069a7-d4f9-4c80-9109-36bafcd60dbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:47.430997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f069a7-d4f9-4c80-9109-36bafcd60dbf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:47.449324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:47.469675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091ec94-5af8-424b-abf1-6e2341634a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:47.470486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091ec94-5af8-424b-abf1-6e2341634a05 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:47.470857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091ec94-5af8-424b-abf1-6e2341634a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.471215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091ec94-5af8-424b-abf1-6e2341634a05 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.471685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:47.472195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091ec94-5af8-424b-abf1-6e2341634a05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:47.472596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091ec94-5af8-424b-abf1-6e2341634a05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:47.474421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091ec94-5af8-424b-abf1-6e2341634a05 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:47.492111 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 432/858] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:47.502058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091ec94-5af8-424b-abf1-6e2341634a05 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:47.559637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 427/859] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:18:47.565660 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009468-733a-4011-b2fb-5cf70d03780b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:47.565990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009468-733a-4011-b2fb-5cf70d03780b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.566225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009468-733a-4011-b2fb-5cf70d03780b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.571508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 428/860] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:47.571508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48009468-733a-4011-b2fb-5cf70d03780b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:47.616202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091ec94-5af8-424b-abf1-6e2341634a05 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:47.650645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee5096-eb0d-4216-ace3-45ed585ef766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:47.651430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee5096-eb0d-4216-ace3-45ed585ef766 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:47.651705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee5096-eb0d-4216-ace3-45ed585ef766 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.651975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee5096-eb0d-4216-ace3-45ed585ef766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.652805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee5096-eb0d-4216-ace3-45ed585ef766 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=d869f947e5b14979b7f44aa19be9ae50) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:47.653142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee5096-eb0d-4216-ace3-45ed585ef766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:47.654570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee5096-eb0d-4216-ace3-45ed585ef766 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:47.660699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 433/861] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:47 2022] GET /identity/v3/role_assignments?user.id=d869f947e5b14979b7f44aa19be9ae50&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:47.666438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82a78-354b-4b0a-8e22-9b9ea8f56dc5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:47.666735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82a78-354b-4b0a-8e22-9b9ea8f56dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.666989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82a78-354b-4b0a-8e22-9b9ea8f56dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.681102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48009468-733a-4011-b2fb-5cf70d03780b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:47.691938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b3b82a78-354b-4b0a-8e22-9b9ea8f56dc5 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:47.694563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b3b82a78-354b-4b0a-8e22-9b9ea8f56dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:47.717831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:47.727828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f487bc-5dba-4aac-a28c-7adb3551f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:47.728393 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f487bc-5dba-4aac-a28c-7adb3551f233 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:47.728689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f487bc-5dba-4aac-a28c-7adb3551f233 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.728918 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f487bc-5dba-4aac-a28c-7adb3551f233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.740831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f487bc-5dba-4aac-a28c-7adb3551f233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:47.742346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f487bc-5dba-4aac-a28c-7adb3551f233 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:47.750021 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-05f487bc-5dba-4aac-a28c-7adb3551f233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:47.764753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:47.765784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:47.766675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:47.766675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:47.766675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:47.766675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:47.770597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 429/862] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:47.771832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f487bc-5dba-4aac-a28c-7adb3551f233 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:47.801149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 434/863] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:47.823965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b82a78-354b-4b0a-8e22-9b9ea8f56dc5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:47.919752 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f487bc-5dba-4aac-a28c-7adb3551f233 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:47.953390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b82a78-354b-4b0a-8e22-9b9ea8f56dc5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:47.962333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b974b-685f-4025-bfb8-7c1878f1771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:47.963139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b974b-685f-4025-bfb8-7c1878f1771d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:47.963412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b974b-685f-4025-bfb8-7c1878f1771d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.963687 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b974b-685f-4025-bfb8-7c1878f1771d None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.964441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b974b-685f-4025-bfb8-7c1878f1771d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:47.964816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b974b-685f-4025-bfb8-7c1878f1771d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:47.966263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b974b-685f-4025-bfb8-7c1878f1771d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:47.980081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 430/864] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:47.988574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b974b-685f-4025-bfb8-7c1878f1771d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:47.995804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85263d6-7f5d-4b13-9db1-7916cc71cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:47.997071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85263d6-7f5d-4b13-9db1-7916cc71cb43 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:47.997355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85263d6-7f5d-4b13-9db1-7916cc71cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:47.997628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85263d6-7f5d-4b13-9db1-7916cc71cb43 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:47.998286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85263d6-7f5d-4b13-9db1-7916cc71cb43 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:48.000333 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85263d6-7f5d-4b13-9db1-7916cc71cb43 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c85263d6-7f5d-4b13-9db1-7916cc71cb43 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:48.016048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:48.017053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:18:48.017907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:48.018701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 435/865] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jul 6 20:18:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:48.023514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85263d6-7f5d-4b13-9db1-7916cc71cb43 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:48.045325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:48.063160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:48.121153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b974b-685f-4025-bfb8-7c1878f1771d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:48.140494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85263d6-7f5d-4b13-9db1-7916cc71cb43 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:48.156837 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c40b0-5c75-444b-a03d-5ac523e053eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:48.157587 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c40b0-5c75-444b-a03d-5ac523e053eb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:48.157869 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c40b0-5c75-444b-a03d-5ac523e053eb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:48.158159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c40b0-5c75-444b-a03d-5ac523e053eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:48.166663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c40b0-5c75-444b-a03d-5ac523e053eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:48.168156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c40b0-5c75-444b-a03d-5ac523e053eb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6a5c40b0-5c75-444b-a03d-5ac523e053eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:48.182943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:48.183843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:48.184991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:48.184991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:48.184991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:48.184991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:48.184991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:48.184991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:48.184991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:48.184991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:48.184991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 431/866] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:48.193046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c40b0-5c75-444b-a03d-5ac523e053eb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:48.197468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ec067-8c34-445c-aedb-2c518ee60f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:48.198925 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ec067-8c34-445c-aedb-2c518ee60f11 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:48.199390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ec067-8c34-445c-aedb-2c518ee60f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:48.199836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ec067-8c34-445c-aedb-2c518ee60f11 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:48.201223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ec067-8c34-445c-aedb-2c518ee60f11 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:48.201711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ec067-8c34-445c-aedb-2c518ee60f11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:48.204141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ec067-8c34-445c-aedb-2c518ee60f11 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:48.215964 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 436/867] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jul 6 20:18:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:48.217296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ec067-8c34-445c-aedb-2c518ee60f11 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:48.307744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:48.311834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c40b0-5c75-444b-a03d-5ac523e053eb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:48.336068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:48.339411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ec067-8c34-445c-aedb-2c518ee60f11 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:48.364994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bf164-1d66-4eef-a87a-bd7a6370ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:48.366627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf164-1d66-4eef-a87a-bd7a6370ba16 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:48.367082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf164-1d66-4eef-a87a-bd7a6370ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:48.367737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf164-1d66-4eef-a87a-bd7a6370ba16 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:48.369139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bf164-1d66-4eef-a87a-bd7a6370ba16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:48.369861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bf164-1d66-4eef-a87a-bd7a6370ba16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:48.372094 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bf164-1d66-4eef-a87a-bd7a6370ba16 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:48.376668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703eff7e-2b97-47d0-a5ce-a368bf413e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:48.377516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703eff7e-2b97-47d0-a5ce-a368bf413e17 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:48.377883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703eff7e-2b97-47d0-a5ce-a368bf413e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:48.378245 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703eff7e-2b97-47d0-a5ce-a368bf413e17 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:48.379106 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703eff7e-2b97-47d0-a5ce-a368bf413e17 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:48.379501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703eff7e-2b97-47d0-a5ce-a368bf413e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:48.381075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703eff7e-2b97-47d0-a5ce-a368bf413e17 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:48.392995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 437/868] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jul 6 20:18:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:48.395636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 432/869] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:48.397158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703eff7e-2b97-47d0-a5ce-a368bf413e17 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:48.631152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703eff7e-2b97-47d0-a5ce-a368bf413e17 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:48.665359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac602bfa-2805-44ff-8550-8ae5194fc450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:48.666080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac602bfa-2805-44ff-8550-8ae5194fc450 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:48.666360 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac602bfa-2805-44ff-8550-8ae5194fc450 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:48.666705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac602bfa-2805-44ff-8550-8ae5194fc450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:48.667582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac602bfa-2805-44ff-8550-8ae5194fc450 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=b11e395dab424f3492f092eb3d5032dd) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:48.667894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac602bfa-2805-44ff-8550-8ae5194fc450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:48.669674 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac602bfa-2805-44ff-8550-8ae5194fc450 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:48.675886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 438/870] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:48 2022] GET /identity/v3/role_assignments?user.id=b11e395dab424f3492f092eb3d5032dd&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:49.363662 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b47d-c2f3-4943-9fa0-1e72264591f6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:49.363948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b47d-c2f3-4943-9fa0-1e72264591f6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:49.364214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b47d-c2f3-4943-9fa0-1e72264591f6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:49.365906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 433/871] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:49.371330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de3b50-39a3-4b16-bf7c-200ee73ce4c1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:49.371621 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de3b50-39a3-4b16-bf7c-200ee73ce4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:49.371893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de3b50-39a3-4b16-bf7c-200ee73ce4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:49.389070 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-98de3b50-39a3-4b16-bf7c-200ee73ce4c1 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:49.390263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-98de3b50-39a3-4b16-bf7c-200ee73ce4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:49.413438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:49.465064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 439/872] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:49.480577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864b47d-c2f3-4943-9fa0-1e72264591f6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:49.585589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864b47d-c2f3-4943-9fa0-1e72264591f6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:49.621298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9468369-c0bb-4e8f-b305-d57fa865b698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:49.621886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468369-c0bb-4e8f-b305-d57fa865b698 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:49.622164 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468369-c0bb-4e8f-b305-d57fa865b698 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:49.622433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468369-c0bb-4e8f-b305-d57fa865b698 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:49.623170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9468369-c0bb-4e8f-b305-d57fa865b698 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:49.624543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9468369-c0bb-4e8f-b305-d57fa865b698 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:49.645109 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 434/873] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:18:49 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:49.857088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2a747-e832-4994-b78a-056977880bfe None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:49.857600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2a747-e832-4994-b78a-056977880bfe None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:49.857675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2a747-e832-4994-b78a-056977880bfe None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:49.859056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 440/874] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:49.864736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5b328-ebb1-4f5e-8e36-ed9db9ac00ef None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:49.865066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5b328-ebb1-4f5e-8e36-ed9db9ac00ef None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:49.865346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5b328-ebb1-4f5e-8e36-ed9db9ac00ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:49.883293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9ad5b328-ebb1-4f5e-8e36-ed9db9ac00ef None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:49.884404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9ad5b328-ebb1-4f5e-8e36-ed9db9ac00ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:49.899322 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:49.965072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 435/875] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:18:49.984149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2a747-e832-4994-b78a-056977880bfe None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:50.089524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2a747-e832-4994-b78a-056977880bfe None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:50.124160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c5651-84fb-4d8f-bb64-ac8ef4f13422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:50.125001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c5651-84fb-4d8f-bb64-ac8ef4f13422 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:50.125285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c5651-84fb-4d8f-bb64-ac8ef4f13422 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:50.125555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c5651-84fb-4d8f-bb64-ac8ef4f13422 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:50.136932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c5651-84fb-4d8f-bb64-ac8ef4f13422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1c1c5651-84fb-4d8f-bb64-ac8ef4f13422 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:50.145413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:50.146387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:50.147215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 441/876] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jul 6 20:18:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:50.152836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5b328-ebb1-4f5e-8e36-ed9db9ac00ef None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:50.255953 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5b328-ebb1-4f5e-8e36-ed9db9ac00ef None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:50.290463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cbe18-2d60-4ff2-a3d8-44ac2c94c0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:50.291147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cbe18-2d60-4ff2-a3d8-44ac2c94c0ab None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:50.291426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cbe18-2d60-4ff2-a3d8-44ac2c94c0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:50.291701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cbe18-2d60-4ff2-a3d8-44ac2c94c0ab None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:50.292458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cbe18-2d60-4ff2-a3d8-44ac2c94c0ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:50.292762 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cbe18-2d60-4ff2-a3d8-44ac2c94c0ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:50.294187 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cbe18-2d60-4ff2-a3d8-44ac2c94c0ab None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:50.307417 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 436/877] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Jul 6 20:18:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:50.310099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c5651-84fb-4d8f-bb64-ac8ef4f13422 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:50.332642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:50.416766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c5651-84fb-4d8f-bb64-ac8ef4f13422 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:50.451190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58719953-c853-4db1-98ab-794f775e52fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:50.452344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719953-c853-4db1-98ab-794f775e52fb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:50.452829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719953-c853-4db1-98ab-794f775e52fb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:50.453295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719953-c853-4db1-98ab-794f775e52fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:50.464331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58719953-c853-4db1-98ab-794f775e52fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:50.466006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58719953-c853-4db1-98ab-794f775e52fb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-58719953-c853-4db1-98ab-794f775e52fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:50.483359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:50.484259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:50.485225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:50.485225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:50.485225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:50.485225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:50.491411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 442/878] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:50.493220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cbe18-2d60-4ff2-a3d8-44ac2c94c0ab None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:50.513351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:50.597264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cbe18-2d60-4ff2-a3d8-44ac2c94c0ab None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:50.600045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906004c9-4c2a-42ef-9a58-848f0eb68b83 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:50.600730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906004c9-4c2a-42ef-9a58-848f0eb68b83 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:50.601254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906004c9-4c2a-42ef-9a58-848f0eb68b83 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:50.603919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 443/879] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:18:50.611510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9a6e8-f2d3-41d6-884d-d0a629195a00 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:50.611510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9a6e8-f2d3-41d6-884d-d0a629195a00 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:50.611510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9a6e8-f2d3-41d6-884d-d0a629195a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:50.633127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8ce9a6e8-f2d3-41d6-884d-d0a629195a00 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:50.634490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8ce9a6e8-f2d3-41d6-884d-d0a629195a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:50.636657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b36c7f-49ee-408e-aa3c-0605ae14ebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:50.637373 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b36c7f-49ee-408e-aa3c-0605ae14ebd0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:50.637657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b36c7f-49ee-408e-aa3c-0605ae14ebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:50.637934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b36c7f-49ee-408e-aa3c-0605ae14ebd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:50.638676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b36c7f-49ee-408e-aa3c-0605ae14ebd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:50.638987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b36c7f-49ee-408e-aa3c-0605ae14ebd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:50.640425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b36c7f-49ee-408e-aa3c-0605ae14ebd0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:50.654026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 437/880] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:50.659518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b36c7f-49ee-408e-aa3c-0605ae14ebd0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:50.711827 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:50.721415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 444/881] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:50 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:50.735382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd612c-a2ff-4011-8b3d-ae61b7976062 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:50.735657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd612c-a2ff-4011-8b3d-ae61b7976062 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:50.736087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd612c-a2ff-4011-8b3d-ae61b7976062 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:50.738450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:50.741241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 445/882] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:18:50.742960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83194bac-0464-4a78-a2a7-c80769fc439b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:50.743243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83194bac-0464-4a78-a2a7-c80769fc439b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:50.743515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83194bac-0464-4a78-a2a7-c80769fc439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:50.760891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-83194bac-0464-4a78-a2a7-c80769fc439b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:50.762102 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-83194bac-0464-4a78-a2a7-c80769fc439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:50.779620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b36c7f-49ee-408e-aa3c-0605ae14ebd0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:50.819414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f8888-acb8-483d-830e-8eeebaf4cf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:50.820575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f8888-acb8-483d-830e-8eeebaf4cf99 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:50.820853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f8888-acb8-483d-830e-8eeebaf4cf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:50.821155 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f8888-acb8-483d-830e-8eeebaf4cf99 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:50.828557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f8888-acb8-483d-830e-8eeebaf4cf99 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:50.830033 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f8888-acb8-483d-830e-8eeebaf4cf99 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:50.839209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 446/883] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:50 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:18:50.840346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83194bac-0464-4a78-a2a7-c80769fc439b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-698f8888-acb8-483d-830e-8eeebaf4cf99 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:50.846136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:50.847072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:50.848031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:50.848031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:50.848031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:50.848031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:50.848031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:50.848031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:50.848031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:50.848031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:50.848031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:50.848031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:50.852053 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 438/884] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jul 6 20:18:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:50.852867 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f8888-acb8-483d-830e-8eeebaf4cf99 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:50.952752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83194bac-0464-4a78-a2a7-c80769fc439b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:50.957064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f8888-acb8-483d-830e-8eeebaf4cf99 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:50.982747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:50.985399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:50.989890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24e950-0b81-455c-bb74-bfebf278145e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:50.990484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24e950-0b81-455c-bb74-bfebf278145e None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:50.990749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24e950-0b81-455c-bb74-bfebf278145e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:50.991023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24e950-0b81-455c-bb74-bfebf278145e None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:50.991738 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24e950-0b81-455c-bb74-bfebf278145e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:50.993134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24e950-0b81-455c-bb74-bfebf278145e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:50.994388 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164baaa-5a0b-478f-9bb1-0a7e254f5bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:50.995152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164baaa-5a0b-478f-9bb1-0a7e254f5bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:50.995330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164baaa-5a0b-478f-9bb1-0a7e254f5bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:50.995597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164baaa-5a0b-478f-9bb1-0a7e254f5bf4 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:50.996568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164baaa-5a0b-478f-9bb1-0a7e254f5bf4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:50.996749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164baaa-5a0b-478f-9bb1-0a7e254f5bf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:50.998238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164baaa-5a0b-478f-9bb1-0a7e254f5bf4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:51.007776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 447/885] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:18:50 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:51.014033 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24e950-0b81-455c-bb74-bfebf278145e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:51.022605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 439/886] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Jul 6 20:18:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:51.023909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164baaa-5a0b-478f-9bb1-0a7e254f5bf4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:51.144238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164baaa-5a0b-478f-9bb1-0a7e254f5bf4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:51.176155 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24e950-0b81-455c-bb74-bfebf278145e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:51.188550 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d96522-0fbc-4549-bb52-5fec3e77a9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:51.189238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d96522-0fbc-4549-bb52-5fec3e77a9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:51.189515 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d96522-0fbc-4549-bb52-5fec3e77a9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:51.189781 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d96522-0fbc-4549-bb52-5fec3e77a9e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:51.231397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035492f8-fb98-4ac5-a3fd-3ff6a6437690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:51.232242 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035492f8-fb98-4ac5-a3fd-3ff6a6437690 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:51.232520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035492f8-fb98-4ac5-a3fd-3ff6a6437690 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:51.232842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035492f8-fb98-4ac5-a3fd-3ff6a6437690 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:51.233487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035492f8-fb98-4ac5-a3fd-3ff6a6437690 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:51.234880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035492f8-fb98-4ac5-a3fd-3ff6a6437690 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-035492f8-fb98-4ac5-a3fd-3ff6a6437690 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:51.251247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:51.252290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:51.253589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 448/887] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jul 6 20:18:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:51.262166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035492f8-fb98-4ac5-a3fd-3ff6a6437690 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:51.264112 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:51.280314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d96522-0fbc-4549-bb52-5fec3e77a9e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:51.282125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d96522-0fbc-4549-bb52-5fec3e77a9e9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:51.329870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:51.403320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 440/888] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:51 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:18:51.404675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d96522-0fbc-4549-bb52-5fec3e77a9e9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:51.416527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035492f8-fb98-4ac5-a3fd-3ff6a6437690 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:51.455180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161dade-3eeb-4365-96a0-8a25abe1cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:51.456304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161dade-3eeb-4365-96a0-8a25abe1cf1c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:51.456833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161dade-3eeb-4365-96a0-8a25abe1cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:51.457331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161dade-3eeb-4365-96a0-8a25abe1cf1c None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:51.458300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161dade-3eeb-4365-96a0-8a25abe1cf1c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:51.458813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161dade-3eeb-4365-96a0-8a25abe1cf1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:51.460500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161dade-3eeb-4365-96a0-8a25abe1cf1c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:51.466219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 449/889] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jul 6 20:18:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:51.471808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161dade-3eeb-4365-96a0-8a25abe1cf1c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:51.492360 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:51.509146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d96522-0fbc-4549-bb52-5fec3e77a9e9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:51.545633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990179b-2efd-486a-8049-61df79b87ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:51.546447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990179b-2efd-486a-8049-61df79b87ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:51.546730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990179b-2efd-486a-8049-61df79b87ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:51.547008 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990179b-2efd-486a-8049-61df79b87ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:51.558112 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990179b-2efd-486a-8049-61df79b87ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:51.559581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990179b-2efd-486a-8049-61df79b87ef6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8990179b-2efd-486a-8049-61df79b87ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:51.577736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:51.578696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:51.579564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:51.579564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:51.579564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:51.579564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:51.583831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 441/890] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:51.584791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990179b-2efd-486a-8049-61df79b87ef6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:51.588789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161dade-3eeb-4365-96a0-8a25abe1cf1c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:51.604182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:51.630183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9db15-a9d8-435b-9ee0-692743880a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:51.631753 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9db15-a9d8-435b-9ee0-692743880a87 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:51.632048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9db15-a9d8-435b-9ee0-692743880a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:51.632328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9db15-a9d8-435b-9ee0-692743880a87 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:51.633137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9db15-a9d8-435b-9ee0-692743880a87 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:51.633449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9db15-a9d8-435b-9ee0-692743880a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:51.635329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9db15-a9d8-435b-9ee0-692743880a87 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:51.648985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 450/891] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jul 6 20:18:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:51.695017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8eedb-41dc-49a4-9ced-4181443d702c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:51.695335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8eedb-41dc-49a4-9ced-4181443d702c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:51.695576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8eedb-41dc-49a4-9ced-4181443d702c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:51.701298 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 451/892] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:51.703310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb97c-4a22-43fa-892b-307cdf8f566c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:51.703594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb97c-4a22-43fa-892b-307cdf8f566c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:51.703869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb97c-4a22-43fa-892b-307cdf8f566c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:51.709124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990179b-2efd-486a-8049-61df79b87ef6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:51.722787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-94afb97c-4a22-43fa-892b-307cdf8f566c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:51.724298 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-94afb97c-4a22-43fa-892b-307cdf8f566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:51.756126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d2da2-c931-48da-92ec-efaeced5f378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:51.757392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d2da2-c931-48da-92ec-efaeced5f378 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:51.757675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d2da2-c931-48da-92ec-efaeced5f378 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:51.757948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d2da2-c931-48da-92ec-efaeced5f378 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:51.758965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d2da2-c931-48da-92ec-efaeced5f378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:51.759692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d2da2-c931-48da-92ec-efaeced5f378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:51.761502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d2da2-c931-48da-92ec-efaeced5f378 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:51.770253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:51.777786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 442/893] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:51.783440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d2da2-c931-48da-92ec-efaeced5f378 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:51.813108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 452/894] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:51.831514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afb97c-4a22-43fa-892b-307cdf8f566c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:51.904490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d2da2-c931-48da-92ec-efaeced5f378 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:51.941948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841e479-c6a6-4481-956a-714a261855a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:51.942879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e479-c6a6-4481-956a-714a261855a6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:51.943221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e479-c6a6-4481-956a-714a261855a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:51.943559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e479-c6a6-4481-956a-714a261855a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:51.950641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841e479-c6a6-4481-956a-714a261855a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:51.952198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841e479-c6a6-4481-956a-714a261855a6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:51.959008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afb97c-4a22-43fa-892b-307cdf8f566c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2841e479-c6a6-4481-956a-714a261855a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:51.966751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:51.967649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:51.968520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:51.968520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:51.968520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:51.968520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:51.968520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:51.968520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:51.968520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:51.968520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:51.968520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 443/895] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:51.977068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:51.977251 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841e479-c6a6-4481-956a-714a261855a6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:52.010552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb222573-0051-42d0-b8f3-0ff542c66a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:52.011940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb222573-0051-42d0-b8f3-0ff542c66a39 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:52.012444 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb222573-0051-42d0-b8f3-0ff542c66a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:52.013838 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb222573-0051-42d0-b8f3-0ff542c66a39 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:52.014713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb222573-0051-42d0-b8f3-0ff542c66a39 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:52.016273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb222573-0051-42d0-b8f3-0ff542c66a39 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bb222573-0051-42d0-b8f3-0ff542c66a39 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:52.030457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:52.031596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:52.032416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 453/896] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:52.037696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb222573-0051-42d0-b8f3-0ff542c66a39 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:52.044899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:52.099963 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841e479-c6a6-4481-956a-714a261855a6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:52.136385 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b611c-d2b3-4236-bc19-639e01f37b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:52.137457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b611c-d2b3-4236-bc19-639e01f37b09 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:52.137930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b611c-d2b3-4236-bc19-639e01f37b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:52.138342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b611c-d2b3-4236-bc19-639e01f37b09 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:52.139298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b611c-d2b3-4236-bc19-639e01f37b09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:52.139790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b611c-d2b3-4236-bc19-639e01f37b09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:52.141467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b611c-d2b3-4236-bc19-639e01f37b09 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:52.146549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb222573-0051-42d0-b8f3-0ff542c66a39 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:52.159372 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 444/897] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:52.160540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b611c-d2b3-4236-bc19-639e01f37b09 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:52.183393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c516-f538-4168-877d-a550da200eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:52.183917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c516-f538-4168-877d-a550da200eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:52.184241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c516-f538-4168-877d-a550da200eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:52.184712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c516-f538-4168-877d-a550da200eb0 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:52.186068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12c516-f538-4168-877d-a550da200eb0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:52.186068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12c516-f538-4168-877d-a550da200eb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:52.187259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12c516-f538-4168-877d-a550da200eb0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:52.193575 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 454/898] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:52.199184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c516-f538-4168-877d-a550da200eb0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:52.242851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:52.298519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b611c-d2b3-4236-bc19-639e01f37b09 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:52.316123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c516-f538-4168-877d-a550da200eb0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:52.318545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:52.336440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8edad2-34dc-499e-a2c3-e3bf330bac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:52.337156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8edad2-34dc-499e-a2c3-e3bf330bac89 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:52.337438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8edad2-34dc-499e-a2c3-e3bf330bac89 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:52.337711 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8edad2-34dc-499e-a2c3-e3bf330bac89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:52.338553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8edad2-34dc-499e-a2c3-e3bf330bac89 None admin] RBAC: Adding query filter params (role.id=c52265f4bfdd4b54a2401176941d60f8, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=d869f947e5b14979b7f44aa19be9ae50) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:52.339014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8edad2-34dc-499e-a2c3-e3bf330bac89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:52.340512 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8edad2-34dc-499e-a2c3-e3bf330bac89 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:52.346671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 445/899] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:18:52 2022] GET /identity/v3/role_assignments?user.id=d869f947e5b14979b7f44aa19be9ae50&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=c52265f4bfdd4b54a2401176941d60f8 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:52.366085 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491cd80-3717-4570-98a9-f751b379889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:52.366845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491cd80-3717-4570-98a9-f751b379889f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:52.367122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491cd80-3717-4570-98a9-f751b379889f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:52.367448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491cd80-3717-4570-98a9-f751b379889f None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:52.368186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491cd80-3717-4570-98a9-f751b379889f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:52.368496 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491cd80-3717-4570-98a9-f751b379889f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:52.369976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491cd80-3717-4570-98a9-f751b379889f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:52.381500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 455/900] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:52.383308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8edad2-34dc-499e-a2c3-e3bf330bac89 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:52.494951 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8edad2-34dc-499e-a2c3-e3bf330bac89 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:52.530351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec38dcf-4027-426e-afde-de0875bdeb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:52.532195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec38dcf-4027-426e-afde-de0875bdeb65 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:52.532195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec38dcf-4027-426e-afde-de0875bdeb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:52.532195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec38dcf-4027-426e-afde-de0875bdeb65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:52.532417 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec38dcf-4027-426e-afde-de0875bdeb65 None admin] RBAC: Adding query filter params (interface=public, service_id=f9b491315bae467eba19ccf4d91b8f6f, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:52.532625 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec38dcf-4027-426e-afde-de0875bdeb65 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:52.534075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec38dcf-4027-426e-afde-de0875bdeb65 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:52.543666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 446/901] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Jul 6 20:18:52 2022] GET /identity/v3/endpoints?service_id=f9b491315bae467eba19ccf4d91b8f6f&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:52.546069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491cd80-3717-4570-98a9-f751b379889f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:52.647293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:52.650612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491cd80-3717-4570-98a9-f751b379889f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:52.685172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747d085-4d92-4003-8b21-3a77a936d469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:52.685835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747d085-4d92-4003-8b21-3a77a936d469 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:52.686117 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747d085-4d92-4003-8b21-3a77a936d469 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:52.686387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747d085-4d92-4003-8b21-3a77a936d469 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:52.687079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747d085-4d92-4003-8b21-3a77a936d469 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:52.688532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747d085-4d92-4003-8b21-3a77a936d469 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:52.698295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 456/902] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Jul 6 20:18:52 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:18:53.117430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fa2b9-57ee-476a-9a82-3d561572dd4f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:53.117831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fa2b9-57ee-476a-9a82-3d561572dd4f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:53.117968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fa2b9-57ee-476a-9a82-3d561572dd4f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:53.119603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 447/903] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:53.124662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05b3b3-268d-4047-9dc1-813f4b1cde94 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:53.125209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05b3b3-268d-4047-9dc1-813f4b1cde94 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:53.125374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05b3b3-268d-4047-9dc1-813f4b1cde94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:53.142207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9a05b3b3-268d-4047-9dc1-813f4b1cde94 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:53.143380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9a05b3b3-268d-4047-9dc1-813f4b1cde94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:53.219878 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 457/904] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:53.241976 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fa2b9-57ee-476a-9a82-3d561572dd4f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:53.290077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:53.345318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fa2b9-57ee-476a-9a82-3d561572dd4f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:53.381829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f57f-76bb-4a77-a9d1-7b9c29f31f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:53.382573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f57f-76bb-4a77-a9d1-7b9c29f31f11 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:53.382851 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f57f-76bb-4a77-a9d1-7b9c29f31f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:53.383123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f57f-76bb-4a77-a9d1-7b9c29f31f11 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:53.383789 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8f57f-76bb-4a77-a9d1-7b9c29f31f11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:53.385191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8f57f-76bb-4a77-a9d1-7b9c29f31f11 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-78f8f57f-76bb-4a77-a9d1-7b9c29f31f11 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:53.397793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:53.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:53.400978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 448/905] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jul 6 20:18:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:53.405043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05b3b3-268d-4047-9dc1-813f4b1cde94 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:53.505564 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:53.513138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05b3b3-268d-4047-9dc1-813f4b1cde94 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:53.547951 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f8f9-46f1-4427-ae92-4ecc7472c5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:53.548642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f8f9-46f1-4427-ae92-4ecc7472c5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:53.548918 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f8f9-46f1-4427-ae92-4ecc7472c5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:53.549232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f8f9-46f1-4427-ae92-4ecc7472c5a7 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:53.549950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021f8f9-46f1-4427-ae92-4ecc7472c5a7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:53.550255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021f8f9-46f1-4427-ae92-4ecc7472c5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:53.551642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021f8f9-46f1-4427-ae92-4ecc7472c5a7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:53.556801 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 458/906] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jul 6 20:18:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:53.561970 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f57f-76bb-4a77-a9d1-7b9c29f31f11 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:53.661300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f57f-76bb-4a77-a9d1-7b9c29f31f11 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:53.671748 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:53.695480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab36de3-f82d-4fae-b35a-15707e4c2828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:53.696170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab36de3-f82d-4fae-b35a-15707e4c2828 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:53.696449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab36de3-f82d-4fae-b35a-15707e4c2828 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:53.696718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab36de3-f82d-4fae-b35a-15707e4c2828 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:53.697477 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab36de3-f82d-4fae-b35a-15707e4c2828 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:53.697778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab36de3-f82d-4fae-b35a-15707e4c2828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:53.699213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab36de3-f82d-4fae-b35a-15707e4c2828 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:53.704694 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 449/907] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jul 6 20:18:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:53.710499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f8f9-46f1-4427-ae92-4ecc7472c5a7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:53.803016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a74f0-11c8-4f35-bfb0-fb0204d91192 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:53.803701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a74f0-11c8-4f35-bfb0-fb0204d91192 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:53.804194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a74f0-11c8-4f35-bfb0-fb0204d91192 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:53.807122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 450/908] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:53.811933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b25e-f0fc-47e7-a296-a5d908875f93 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:53.813018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b25e-f0fc-47e7-a296-a5d908875f93 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:53.814675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b25e-f0fc-47e7-a296-a5d908875f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:53.821592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f8f9-46f1-4427-ae92-4ecc7472c5a7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:53.843792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c245b25e-f0fc-47e7-a296-a5d908875f93 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:53.845169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c245b25e-f0fc-47e7-a296-a5d908875f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:53.860049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad1c87-d23e-4e4b-8c46-3642169222f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:53.861039 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad1c87-d23e-4e4b-8c46-3642169222f8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:53.861487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad1c87-d23e-4e4b-8c46-3642169222f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:53.861924 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad1c87-d23e-4e4b-8c46-3642169222f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:53.863381 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad1c87-d23e-4e4b-8c46-3642169222f8 None admin] RBAC: Adding query filter params (interface=public, service_id=eec4800950e4415a90d734aa51335cb9, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:53.863864 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad1c87-d23e-4e4b-8c46-3642169222f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:53.865728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad1c87-d23e-4e4b-8c46-3642169222f8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:53.872122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 459/909] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Jul 6 20:18:53 2022] GET /identity/v3/endpoints?service_id=eec4800950e4415a90d734aa51335cb9&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:53.878040 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad1c87-d23e-4e4b-8c46-3642169222f8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:53.906912 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:53.937917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 451/910] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:18:53.966304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245b25e-f0fc-47e7-a296-a5d908875f93 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:53.992358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad1c87-d23e-4e4b-8c46-3642169222f8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:54.028773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7792ea-8a32-4a50-af05-554d82651cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:54.029764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7792ea-8a32-4a50-af05-554d82651cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:54.030310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7792ea-8a32-4a50-af05-554d82651cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:54.030778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7792ea-8a32-4a50-af05-554d82651cd7 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:54.031705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7792ea-8a32-4a50-af05-554d82651cd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:54.033403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7792ea-8a32-4a50-af05-554d82651cd7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:54.040315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 460/911] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Jul 6 20:18:53 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:18:54.082335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245b25e-f0fc-47e7-a296-a5d908875f93 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:54.084941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:54.120423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38a389-5175-4743-b3aa-359c5209ceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:54.121160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38a389-5175-4743-b3aa-359c5209ceb7 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:54.121442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38a389-5175-4743-b3aa-359c5209ceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:54.121713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38a389-5175-4743-b3aa-359c5209ceb7 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:54.122456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38a389-5175-4743-b3aa-359c5209ceb7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:54.123855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38a389-5175-4743-b3aa-359c5209ceb7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:54.145120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 452/912] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:18:53 2022] POST /identity/v3/services => generated 241 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:18:54.439435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9419c2b-3e9e-4db1-8e0f-c7dea669b6cd None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:54.439970 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9419c2b-3e9e-4db1-8e0f-c7dea669b6cd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:54.439970 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9419c2b-3e9e-4db1-8e0f-c7dea669b6cd None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:54.441616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 461/913] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:54.447069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2630b-1fca-4c0e-90d4-76c5a522c75c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:54.447355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2630b-1fca-4c0e-90d4-76c5a522c75c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:54.447626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2630b-1fca-4c0e-90d4-76c5a522c75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:54.464592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0bf2630b-1fca-4c0e-90d4-76c5a522c75c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:54.465787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0bf2630b-1fca-4c0e-90d4-76c5a522c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:54.542056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 453/914] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:18:54.563676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9419c2b-3e9e-4db1-8e0f-c7dea669b6cd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:54.649542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:54.665923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9419c2b-3e9e-4db1-8e0f-c7dea669b6cd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:54.699764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe18cd-f95a-49bc-98bd-d6b6e9abe253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:54.700497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe18cd-f95a-49bc-98bd-d6b6e9abe253 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:54.700767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe18cd-f95a-49bc-98bd-d6b6e9abe253 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:54.701061 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe18cd-f95a-49bc-98bd-d6b6e9abe253 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:54.711309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe18cd-f95a-49bc-98bd-d6b6e9abe253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a5fe18cd-f95a-49bc-98bd-d6b6e9abe253 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:54.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:54.720342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:54.721222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 462/915] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jul 6 20:18:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:54.727050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2630b-1fca-4c0e-90d4-76c5a522c75c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:54.812569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9b918-886d-4299-b40c-7ace0a713c6a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:54.812845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9b918-886d-4299-b40c-7ace0a713c6a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:54.813204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9b918-886d-4299-b40c-7ace0a713c6a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:54.814933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 463/916] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:54.820087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7dd20-3416-4d47-9b69-7fc1f9b97180 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:54.820373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7dd20-3416-4d47-9b69-7fc1f9b97180 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:54.820653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7dd20-3416-4d47-9b69-7fc1f9b97180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:54.829330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:54.840873 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2630b-1fca-4c0e-90d4-76c5a522c75c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:54.842508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ffd7dd20-3416-4d47-9b69-7fc1f9b97180 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:54.843816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ffd7dd20-3416-4d47-9b69-7fc1f9b97180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:54.882887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731552e-4c1c-4d88-b1d5-f7c34be38ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:54.883586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731552e-4c1c-4d88-b1d5-f7c34be38ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:54.883866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731552e-4c1c-4d88-b1d5-f7c34be38ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:54.884140 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731552e-4c1c-4d88-b1d5-f7c34be38ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:54.884908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731552e-4c1c-4d88-b1d5-f7c34be38ed9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:54.885243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731552e-4c1c-4d88-b1d5-f7c34be38ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:54.887126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731552e-4c1c-4d88-b1d5-f7c34be38ed9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:54.898285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 454/917] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Jul 6 20:18:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:54.903941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731552e-4c1c-4d88-b1d5-f7c34be38ed9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:54.921124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 464/918] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:18:54.939033 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7dd20-3416-4d47-9b69-7fc1f9b97180 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:55.022265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:55.036155 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731552e-4c1c-4d88-b1d5-f7c34be38ed9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:55.048840 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7dd20-3416-4d47-9b69-7fc1f9b97180 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:55.078853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd6ce8-3699-4e8e-a789-10f7348ef8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:55.080165 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6ce8-3699-4e8e-a789-10f7348ef8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:55.080656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6ce8-3699-4e8e-a789-10f7348ef8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:55.081132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6ce8-3699-4e8e-a789-10f7348ef8e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:55.083477 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a6b5a-cbf9-4c0f-b135-195b8d1c79fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:55.084382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a6b5a-cbf9-4c0f-b135-195b8d1c79fa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:55.084682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a6b5a-cbf9-4c0f-b135-195b8d1c79fa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:55.085072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a6b5a-cbf9-4c0f-b135-195b8d1c79fa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:55.085806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a6b5a-cbf9-4c0f-b135-195b8d1c79fa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:55.087248 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a6b5a-cbf9-4c0f-b135-195b8d1c79fa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:55.094012 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd6ce8-3699-4e8e-a789-10f7348ef8e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:55.095621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd6ce8-3699-4e8e-a789-10f7348ef8e6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-377a6b5a-cbf9-4c0f-b135-195b8d1c79fa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:55.099435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:55.100423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:18:55.101293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:55.105498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 465/919] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:55.107018 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a6b5a-cbf9-4c0f-b135-195b8d1c79fa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e0bd6ce8-3699-4e8e-a789-10f7348ef8e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:55.118025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:55.118897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:55.119772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:55.119772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:55.119772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:55.119772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:55.126458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 455/920] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:55.127484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd6ce8-3699-4e8e-a789-10f7348ef8e6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:55.132691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:55.226250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a6b5a-cbf9-4c0f-b135-195b8d1c79fa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:55.250144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd6ce8-3699-4e8e-a789-10f7348ef8e6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:55.276133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe1c61-e292-4e45-b3df-5e4f550657ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:55.277625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe1c61-e292-4e45-b3df-5e4f550657ec None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:55.278361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe1c61-e292-4e45-b3df-5e4f550657ec None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:55.278843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe1c61-e292-4e45-b3df-5e4f550657ec None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:55.279909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe1c61-e292-4e45-b3df-5e4f550657ec None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:55.280659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe1c61-e292-4e45-b3df-5e4f550657ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:55.282657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe1c61-e292-4e45-b3df-5e4f550657ec None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:55.288746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 466/921] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:55.293916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c95a2-1e6f-446a-b47b-3ae47ccb5581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:55.294619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c95a2-1e6f-446a-b47b-3ae47ccb5581 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:55.294892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c95a2-1e6f-446a-b47b-3ae47ccb5581 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:55.295162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c95a2-1e6f-446a-b47b-3ae47ccb5581 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:55.295917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c95a2-1e6f-446a-b47b-3ae47ccb5581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:55.296219 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c95a2-1e6f-446a-b47b-3ae47ccb5581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:55.297696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c95a2-1e6f-446a-b47b-3ae47ccb5581 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:55.298281 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe1c61-e292-4e45-b3df-5e4f550657ec None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:55.304788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:55.316300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 456/922] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:55.317356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c95a2-1e6f-446a-b47b-3ae47ccb5581 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:55.379123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:55.411966 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe1c61-e292-4e45-b3df-5e4f550657ec None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:55.416414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c95a2-1e6f-446a-b47b-3ae47ccb5581 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:55.448112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fcafc-9cd7-46d7-a6d0-21cb6d1dfc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:55.449430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fcafc-9cd7-46d7-a6d0-21cb6d1dfc36 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:55.449861 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fcafc-9cd7-46d7-a6d0-21cb6d1dfc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:55.450267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fcafc-9cd7-46d7-a6d0-21cb6d1dfc36 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:55.450843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc01b23-1dad-423c-8518-479f4cf25e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:55.451274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fcafc-9cd7-46d7-a6d0-21cb6d1dfc36 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:55.451727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fcafc-9cd7-46d7-a6d0-21cb6d1dfc36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:55.451948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc01b23-1dad-423c-8518-479f4cf25e36 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:55.452320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc01b23-1dad-423c-8518-479f4cf25e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:55.452673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc01b23-1dad-423c-8518-479f4cf25e36 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:55.453760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fcafc-9cd7-46d7-a6d0-21cb6d1dfc36 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:55.463766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc01b23-1dad-423c-8518-479f4cf25e36 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:55.463766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc01b23-1dad-423c-8518-479f4cf25e36 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:55.464035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 467/923] 10.222.0.30 () {56 vars in 1114 bytes} [Wed Jul 6 20:18:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:55.465074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fcafc-9cd7-46d7-a6d0-21cb6d1dfc36 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-bfc01b23-1dad-423c-8518-479f4cf25e36 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:55.477098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:55.478238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:55.479211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:55.479211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:55.479211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:55.479211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:55.479211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:55.479211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:55.479211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:55.479211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:55.479211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:55.479211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:55.484159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 457/924] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jul 6 20:18:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:55.485152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc01b23-1dad-423c-8518-479f4cf25e36 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:55.542736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:55.581991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fcafc-9cd7-46d7-a6d0-21cb6d1dfc36 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:55.585874 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc01b23-1dad-423c-8518-479f4cf25e36 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:55.611031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:55.619859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ee071-9674-4c24-882e-ecb0111e0916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:55.620796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ee071-9674-4c24-882e-ecb0111e0916 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:55.621389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ee071-9674-4c24-882e-ecb0111e0916 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:55.621828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ee071-9674-4c24-882e-ecb0111e0916 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:55.622678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4f12d-a7df-48e4-9913-74a9b06ea2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:55.622991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ee071-9674-4c24-882e-ecb0111e0916 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:55.623467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4f12d-a7df-48e4-9913-74a9b06ea2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:55.623806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4f12d-a7df-48e4-9913-74a9b06ea2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:55.624137 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4f12d-a7df-48e4-9913-74a9b06ea2e3 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:55.625076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4f12d-a7df-48e4-9913-74a9b06ea2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:55.625245 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ee071-9674-4c24-882e-ecb0111e0916 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:55.625506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4f12d-a7df-48e4-9913-74a9b06ea2e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:55.627095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4f12d-a7df-48e4-9913-74a9b06ea2e3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:55.652190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 458/926] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Jul 6 20:18:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:55.652522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 468/926] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Jul 6 20:18:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:55.653188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4f12d-a7df-48e4-9913-74a9b06ea2e3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:55.764018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4f12d-a7df-48e4-9913-74a9b06ea2e3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:55.812852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d83e-526c-4967-a22a-2669b76b336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:55.812852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d83e-526c-4967-a22a-2669b76b336b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:55.812852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d83e-526c-4967-a22a-2669b76b336b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:55.812852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d83e-526c-4967-a22a-2669b76b336b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:55.825529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1d83e-526c-4967-a22a-2669b76b336b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:55.825529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1d83e-526c-4967-a22a-2669b76b336b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-76e1d83e-526c-4967-a22a-2669b76b336b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:55.844464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:55.845518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:55.846469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:55.846469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:55.846469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:55.846469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:55.847125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 459/927] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:55.854169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ee071-9674-4c24-882e-ecb0111e0916 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:55.966850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ee071-9674-4c24-882e-ecb0111e0916 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:55.990789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:56.004475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7ce75-acdd-4888-84ae-486486ac06a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:56.005319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7ce75-acdd-4888-84ae-486486ac06a2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.005595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7ce75-acdd-4888-84ae-486486ac06a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.005863 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7ce75-acdd-4888-84ae-486486ac06a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.006932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7ce75-acdd-4888-84ae-486486ac06a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:56.007237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7ce75-acdd-4888-84ae-486486ac06a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:56.008608 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7ce75-acdd-4888-84ae-486486ac06a2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:56.020932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 469/928] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:56.026615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d83e-526c-4967-a22a-2669b76b336b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:56.063472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:56.136596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d83e-526c-4967-a22a-2669b76b336b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:56.175020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef515d6a-dd26-40ce-b86b-d11175473950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:56.175843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef515d6a-dd26-40ce-b86b-d11175473950 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.176121 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef515d6a-dd26-40ce-b86b-d11175473950 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.176396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef515d6a-dd26-40ce-b86b-d11175473950 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.183412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef515d6a-dd26-40ce-b86b-d11175473950 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:56.184869 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef515d6a-dd26-40ce-b86b-d11175473950 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ef515d6a-dd26-40ce-b86b-d11175473950 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:56.199015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:56.199968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:56.200852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:56.200852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:56.200852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:56.200852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:56.200852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:56.200852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:56.200852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:56.200852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:56.201348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4ba87-0ee6-4055-bdf9-10a3e80624ae None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.201348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4ba87-0ee6-4055-bdf9-10a3e80624ae None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.201490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 460/929] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:56.201563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4ba87-0ee6-4055-bdf9-10a3e80624ae None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.205689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 470/930] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:56.206951 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4ba87-0ee6-4055-bdf9-10a3e80624ae None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:56.207301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb02164-1dea-4085-b132-d0928ac34c6c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.207591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb02164-1dea-4085-b132-d0928ac34c6c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.207913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb02164-1dea-4085-b132-d0928ac34c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.224908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6cb02164-1dea-4085-b132-d0928ac34c6c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:56.227388 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6cb02164-1dea-4085-b132-d0928ac34c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:56.307986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 461/931] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:56.309795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa0ab9-6ee0-4532-8e00-48e4a8fea2ea None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.310310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa0ab9-6ee0-4532-8e00-48e4a8fea2ea None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.310781 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa0ab9-6ee0-4532-8e00-48e4a8fea2ea None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.312498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 462/932] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:56.321079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98a3a0-204f-42d0-a9c9-2a96c94a358d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.321079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98a3a0-204f-42d0-a9c9-2a96c94a358d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.321324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4ba87-0ee6-4055-bdf9-10a3e80624ae None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:56.321410 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98a3a0-204f-42d0-a9c9-2a96c94a358d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.335880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4e98a3a0-204f-42d0-a9c9-2a96c94a358d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:56.337123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4e98a3a0-204f-42d0-a9c9-2a96c94a358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:56.352314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:56.354758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228f367-d3cc-4b5f-9cd8-bff94721acb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:56.355657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f367-d3cc-4b5f-9cd8-bff94721acb9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.356151 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f367-d3cc-4b5f-9cd8-bff94721acb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.356513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f367-d3cc-4b5f-9cd8-bff94721acb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.357335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228f367-d3cc-4b5f-9cd8-bff94721acb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:56.357644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228f367-d3cc-4b5f-9cd8-bff94721acb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:56.359509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228f367-d3cc-4b5f-9cd8-bff94721acb9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:56.376474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 471/933] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:18:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:56.376474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228f367-d3cc-4b5f-9cd8-bff94721acb9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:56.411832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 463/934] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:56.412584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98a3a0-204f-42d0-a9c9-2a96c94a358d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:56.436911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:56.496439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228f367-d3cc-4b5f-9cd8-bff94721acb9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:56.517340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98a3a0-204f-42d0-a9c9-2a96c94a358d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:56.530935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53348eb3-2396-425a-8e2c-907c919d9566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:56.531713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348eb3-2396-425a-8e2c-907c919d9566 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.531992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348eb3-2396-425a-8e2c-907c919d9566 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.532579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348eb3-2396-425a-8e2c-907c919d9566 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.532935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53348eb3-2396-425a-8e2c-907c919d9566 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:56.534412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53348eb3-2396-425a-8e2c-907c919d9566 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-53348eb3-2396-425a-8e2c-907c919d9566 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:56.546902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:56.547921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:56.548780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 472/935] 10.222.0.30 () {56 vars in 1132 bytes} [Wed Jul 6 20:18:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:56.549661 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53348eb3-2396-425a-8e2c-907c919d9566 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:56.558786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd54db9-d7e3-4dad-997d-44e7bcad1efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:56.559686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54db9-d7e3-4dad-997d-44e7bcad1efb None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.559962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54db9-d7e3-4dad-997d-44e7bcad1efb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.560233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54db9-d7e3-4dad-997d-44e7bcad1efb None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/d869f947e5b14979b7f44aa19be9ae50/roles/c52265f4bfdd4b54a2401176941d60f8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.563153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd54db9-d7e3-4dad-997d-44e7bcad1efb None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=d869f947e5b14979b7f44aa19be9ae50, role_id=c52265f4bfdd4b54a2401176941d60f8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:56.564589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd54db9-d7e3-4dad-997d-44e7bcad1efb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:56.585695 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 464/936] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:18:56 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/d869f947e5b14979b7f44aa19be9ae50/roles/c52265f4bfdd4b54a2401176941d60f8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:18:56.585695 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd54db9-d7e3-4dad-997d-44e7bcad1efb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:56.605846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:56.693034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53348eb3-2396-425a-8e2c-907c919d9566 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:56.705467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:56.721039 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd54db9-d7e3-4dad-997d-44e7bcad1efb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:56.741054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c477b0-d126-43a1-826c-5dc92ebc8f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:56.741879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c477b0-d126-43a1-826c-5dc92ebc8f7e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.742171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c477b0-d126-43a1-826c-5dc92ebc8f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.742436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c477b0-d126-43a1-826c-5dc92ebc8f7e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.743571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c477b0-d126-43a1-826c-5dc92ebc8f7e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:56.745950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c477b0-d126-43a1-826c-5dc92ebc8f7e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:56.759932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493682f-b530-4770-b806-65ea12e79f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-28c477b0-d126-43a1-826c-5dc92ebc8f7e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:56.760437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:56.761458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:18:56.762301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:56.763075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493682f-b530-4770-b806-65ea12e79f1c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.763075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493682f-b530-4770-b806-65ea12e79f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.763075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493682f-b530-4770-b806-65ea12e79f1c None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.763075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493682f-b530-4770-b806-65ea12e79f1c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:56.763329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 473/937] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jul 6 20:18:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:56.763408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493682f-b530-4770-b806-65ea12e79f1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:56.763776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493682f-b530-4770-b806-65ea12e79f1c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:56.772731 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c477b0-d126-43a1-826c-5dc92ebc8f7e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:56.773856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 465/938] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jul 6 20:18:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:56.779344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493682f-b530-4770-b806-65ea12e79f1c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:56.870808 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:56.903308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493682f-b530-4770-b806-65ea12e79f1c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:56.918781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c477b0-d126-43a1-826c-5dc92ebc8f7e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:56.945948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f29fb1-b219-4125-82c3-af7f16961b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:56.947063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f29fb1-b219-4125-82c3-af7f16961b80 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.947595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f29fb1-b219-4125-82c3-af7f16961b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.948072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f29fb1-b219-4125-82c3-af7f16961b80 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.949089 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f29fb1-b219-4125-82c3-af7f16961b80 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:56.949606 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f29fb1-b219-4125-82c3-af7f16961b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:56.951230 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f29fb1-b219-4125-82c3-af7f16961b80 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:56.957318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 466/939] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jul 6 20:18:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:56.962705 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f29fb1-b219-4125-82c3-af7f16961b80 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:56.966838 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03399b7e-093b-43a2-b17b-bcd5da0edf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:56.967514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03399b7e-093b-43a2-b17b-bcd5da0edf0a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:56.967767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03399b7e-093b-43a2-b17b-bcd5da0edf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:56.968066 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03399b7e-093b-43a2-b17b-bcd5da0edf0a None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:56.968803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03399b7e-093b-43a2-b17b-bcd5da0edf0a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:56.969135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03399b7e-093b-43a2-b17b-bcd5da0edf0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:56.970532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03399b7e-093b-43a2-b17b-bcd5da0edf0a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:56.980696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 474/940] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jul 6 20:18:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:56.981825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03399b7e-093b-43a2-b17b-bcd5da0edf0a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:57.024713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:57.087600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f29fb1-b219-4125-82c3-af7f16961b80 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:57.099895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03399b7e-093b-43a2-b17b-bcd5da0edf0a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:57.132459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23088766-cb46-4394-b76b-041f6fd36ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:57.133078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088766-cb46-4394-b76b-041f6fd36ef4 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:57.133361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088766-cb46-4394-b76b-041f6fd36ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:57.133639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088766-cb46-4394-b76b-041f6fd36ef4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:57.134394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23088766-cb46-4394-b76b-041f6fd36ef4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:57.135974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23088766-cb46-4394-b76b-041f6fd36ef4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:57.136465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d5493-65fa-47b2-b923-67b7ca3ab4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:57.137384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d5493-65fa-47b2-b923-67b7ca3ab4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:57.137852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d5493-65fa-47b2-b923-67b7ca3ab4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:57.138318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d5493-65fa-47b2-b923-67b7ca3ab4a3 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:57.139235 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d5493-65fa-47b2-b923-67b7ca3ab4a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:57.139632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d5493-65fa-47b2-b923-67b7ca3ab4a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:57.141109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d5493-65fa-47b2-b923-67b7ca3ab4a3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:57.144562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:57.152299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 475/941] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jul 6 20:18:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:18:57.153547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d5493-65fa-47b2-b923-67b7ca3ab4a3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:57.161667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 467/942] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Jul 6 20:18:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:18:57.270846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:57.276217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d5493-65fa-47b2-b923-67b7ca3ab4a3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:57.321650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727e9ce-d557-461b-9705-f71d55df49ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:57.322596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e9ce-d557-461b-9705-f71d55df49ab None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:57.323020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e9ce-d557-461b-9705-f71d55df49ab None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:57.323456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e9ce-d557-461b-9705-f71d55df49ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:57.324399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727e9ce-d557-461b-9705-f71d55df49ab None admin] RBAC: Adding query filter params (interface=public, service_id=7f86f73d04914a18832da37c1372d192, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:57.324874 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727e9ce-d557-461b-9705-f71d55df49ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:57.326432 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727e9ce-d557-461b-9705-f71d55df49ab None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:57.332696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 476/943] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Jul 6 20:18:57 2022] GET /identity/v3/endpoints?service_id=7f86f73d04914a18832da37c1372d192&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:57.338406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23088766-cb46-4394-b76b-041f6fd36ef4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:57.443871 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23088766-cb46-4394-b76b-041f6fd36ef4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:57.479247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc3e30-d2e6-4cf9-bdc0-14c94141a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:57.480208 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc3e30-d2e6-4cf9-bdc0-14c94141a911 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:57.480711 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc3e30-d2e6-4cf9-bdc0-14c94141a911 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:57.481174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc3e30-d2e6-4cf9-bdc0-14c94141a911 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:57.482009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc3e30-d2e6-4cf9-bdc0-14c94141a911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:57.483529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc3e30-d2e6-4cf9-bdc0-14c94141a911 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:57.490588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 468/944] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Jul 6 20:18:57 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:18:57.885533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ef842-1713-4a9c-b3aa-98c02bf3ffa4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:57.886566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ef842-1713-4a9c-b3aa-98c02bf3ffa4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:57.887048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ef842-1713-4a9c-b3aa-98c02bf3ffa4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:57.888884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 477/945] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:57.893860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d3699-0eb5-42c9-b9b1-8c47191bdabd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:57.894311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d3699-0eb5-42c9-b9b1-8c47191bdabd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:57.894399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d3699-0eb5-42c9-b9b1-8c47191bdabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:57.911655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e22d3699-0eb5-42c9-b9b1-8c47191bdabd None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:57.912830 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e22d3699-0eb5-42c9-b9b1-8c47191bdabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:57.967484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:57.982308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 469/946] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:18:58.005381 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ef842-1713-4a9c-b3aa-98c02bf3ffa4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:58.108090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ef842-1713-4a9c-b3aa-98c02bf3ffa4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:58.142309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2692fe-44a6-451e-9795-77662eb0432d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:58.142976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2692fe-44a6-451e-9795-77662eb0432d None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:58.143251 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2692fe-44a6-451e-9795-77662eb0432d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:58.143522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2692fe-44a6-451e-9795-77662eb0432d None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:58.144244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2692fe-44a6-451e-9795-77662eb0432d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:58.145769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2692fe-44a6-451e-9795-77662eb0432d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:58.147138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: WARNING keystone.server.flask.common [None req-ae2692fe-44a6-451e-9795-77662eb0432d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 06 20:18:58.166628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.sql.core [None req-ae2692fe-44a6-451e-9795-77662eb0432d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 20:18:58.166628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 06 20:18:58.166628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [parameters: {'id': '4899a5b0867e4e68b1bf4ed8f0dfa0c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 06 20:18:58.166628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80332) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ae2692fe-44a6-451e-9795-77662eb0432d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4899a5b0867e4e68b1bf4ed8f0dfa0c9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4899a5b0867e4e68b1bf4ed8f0dfa0c9. Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:18:58.175096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 06 20:18:58.175922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application yield resource Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise self.value Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application session.commit() Jul 06 20:18:58.177048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.flush() Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application compat.raise_( Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 20:18:58.177934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 20:18:58.178835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:18:58.179637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [parameters: {'id': '4899a5b0867e4e68b1bf4ed8f0dfa0c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:58.180488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:58.182755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:58.184816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:58.184816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 06 20:18:58.184816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 06 20:18:58.184816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:58.184816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:58.184816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 06 20:18:58.184816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 06 20:18:58.184816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4899a5b0867e4e68b1bf4ed8f0dfa0c9. Jul 06 20:18:58.184816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:58.184816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 478/947] 10.222.0.30 () {60 vars in 1140 bytes} [Wed Jul 6 20:18:58 2022] POST /identity/v3/projects => generated 262 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:58.194340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d3699-0eb5-42c9-b9b1-8c47191bdabd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:58.287016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d3699-0eb5-42c9-b9b1-8c47191bdabd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:58.321285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf63447-991a-4d5c-8b5e-c246dda3dfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:58.322093 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf63447-991a-4d5c-8b5e-c246dda3dfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:58.322370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf63447-991a-4d5c-8b5e-c246dda3dfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:58.322639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf63447-991a-4d5c-8b5e-c246dda3dfb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:58.329522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf63447-991a-4d5c-8b5e-c246dda3dfb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:58.330962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf63447-991a-4d5c-8b5e-c246dda3dfb6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7cf63447-991a-4d5c-8b5e-c246dda3dfb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:18:58.344845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:58.346807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:58.348905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:18:58.348905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:18:58.348905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:18:58.348905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:18:58.348905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:18:58.348905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:18:58.348905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:18:58.348905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:58.348905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 470/948] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:58.354558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2692fe-44a6-451e-9795-77662eb0432d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:58.381891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:58.461449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2692fe-44a6-451e-9795-77662eb0432d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:58.495631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34722603-417c-485f-bbc8-888f1fea7a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:58.496292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722603-417c-485f-bbc8-888f1fea7a11 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:58.496568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722603-417c-485f-bbc8-888f1fea7a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:58.496836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722603-417c-485f-bbc8-888f1fea7a11 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:58.497636 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34722603-417c-485f-bbc8-888f1fea7a11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:58.498072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34722603-417c-485f-bbc8-888f1fea7a11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:58.499702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34722603-417c-485f-bbc8-888f1fea7a11 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:58.525246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 479/949] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:18:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:58.701650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf53fd2-6060-4fae-a81c-9641b76b3b78 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:58.702021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf53fd2-6060-4fae-a81c-9641b76b3b78 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:58.702184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf53fd2-6060-4fae-a81c-9641b76b3b78 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:58.703486 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 471/950] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:58.709041 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db51390-58b4-4b60-a5b9-478252a58a7f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:58.709327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db51390-58b4-4b60-a5b9-478252a58a7f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:58.709611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db51390-58b4-4b60-a5b9-478252a58a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:58.727455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0db51390-58b4-4b60-a5b9-478252a58a7f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:58.728986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0db51390-58b4-4b60-a5b9-478252a58a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:58.798612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 480/951] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:58.821499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf53fd2-6060-4fae-a81c-9641b76b3b78 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:58.875096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:58.928733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf53fd2-6060-4fae-a81c-9641b76b3b78 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:58.965103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f4c20-0516-44b7-889c-e6b44abc1ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:58.965940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4c20-0516-44b7-889c-e6b44abc1ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:58.966227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4c20-0516-44b7-889c-e6b44abc1ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:58.966505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4c20-0516-44b7-889c-e6b44abc1ff2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:58.977703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f4c20-0516-44b7-889c-e6b44abc1ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-924f4c20-0516-44b7-889c-e6b44abc1ff2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:18:58.986136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:58.987081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:58.987910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 472/952] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jul 6 20:18:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:58.993854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db51390-58b4-4b60-a5b9-478252a58a7f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:59.002339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:59.096152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db51390-58b4-4b60-a5b9-478252a58a7f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:59.130165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bcc11-eb65-49e9-9016-ea0a3b469e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:59.130895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bcc11-eb65-49e9-9016-ea0a3b469e2b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.131584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bcc11-eb65-49e9-9016-ea0a3b469e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.131816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bcc11-eb65-49e9-9016-ea0a3b469e2b None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.132573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bcc11-eb65-49e9-9016-ea0a3b469e2b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:59.132885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bcc11-eb65-49e9-9016-ea0a3b469e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:59.134267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bcc11-eb65-49e9-9016-ea0a3b469e2b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:59.143017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 481/953] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Jul 6 20:18:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:59.148669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f4c20-0516-44b7-889c-e6b44abc1ff2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:59.253820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f4c20-0516-44b7-889c-e6b44abc1ff2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:59.265425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:59.290227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579c150-c95f-4e83-a21c-decc5083779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:59.291109 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579c150-c95f-4e83-a21c-decc5083779c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.291392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579c150-c95f-4e83-a21c-decc5083779c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.291717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579c150-c95f-4e83-a21c-decc5083779c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.303605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579c150-c95f-4e83-a21c-decc5083779c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:59.305107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579c150-c95f-4e83-a21c-decc5083779c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7579c150-c95f-4e83-a21c-decc5083779c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:18:59.323933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:59.324934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:59.325899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:18:59.325899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:18:59.325899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:18:59.325899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:59.325899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 473/954] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:59.331237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bcc11-eb65-49e9-9016-ea0a3b469e2b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:59.346431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06e0b-2f61-4bfb-9b4c-ba92f35256c8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.346778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06e0b-2f61-4bfb-9b4c-ba92f35256c8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.347051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06e0b-2f61-4bfb-9b4c-ba92f35256c8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.348761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 474/955] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:59.354074 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9353a3-c984-4f4c-bd7d-d7e5d097a263 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.354445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9353a3-c984-4f4c-bd7d-d7e5d097a263 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.354797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9353a3-c984-4f4c-bd7d-d7e5d097a263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.372132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4d9353a3-c984-4f4c-bd7d-d7e5d097a263 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:59.373434 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4d9353a3-c984-4f4c-bd7d-d7e5d097a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:59.405268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:59.447209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bcc11-eb65-49e9-9016-ea0a3b469e2b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:59.451590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 475/956] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:18:59.471197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9353a3-c984-4f4c-bd7d-d7e5d097a263 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:59.488774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfffd70-2eab-40f3-88e3-861c77b3b49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:59.489769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffd70-2eab-40f3-88e3-861c77b3b49d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.490074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffd70-2eab-40f3-88e3-861c77b3b49d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.490679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffd70-2eab-40f3-88e3-861c77b3b49d None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.491407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfffd70-2eab-40f3-88e3-861c77b3b49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:59.491712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfffd70-2eab-40f3-88e3-861c77b3b49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:59.493106 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfffd70-2eab-40f3-88e3-861c77b3b49d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:59.510539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 482/957] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:59.516905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfffd70-2eab-40f3-88e3-861c77b3b49d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:59.579361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:59.591566 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9353a3-c984-4f4c-bd7d-d7e5d097a263 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:59.620834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfffd70-2eab-40f3-88e3-861c77b3b49d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:59.626723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316cc5c-8a54-4d65-b62f-cd231293d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:59.627526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316cc5c-8a54-4d65-b62f-cd231293d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.627801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316cc5c-8a54-4d65-b62f-cd231293d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.628462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316cc5c-8a54-4d65-b62f-cd231293d0b9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.629150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316cc5c-8a54-4d65-b62f-cd231293d0b9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:59.631244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316cc5c-8a54-4d65-b62f-cd231293d0b9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e316cc5c-8a54-4d65-b62f-cd231293d0b9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:59.643968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:59.645420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:59.646518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 476/958] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:18:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:18:59.647773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5079b0-f7c3-46b4-90c3-c046bff56d0b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.647773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5079b0-f7c3-46b4-90c3-c046bff56d0b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.647773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5079b0-f7c3-46b4-90c3-c046bff56d0b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.649405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 477/959] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:18:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:18:59.655130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5079b0-f7c3-46b4-90c3-c046bff56d0b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:59.656276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:59.665076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0719ff9-4a3f-47b4-9cb5-31037e878da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:59.665911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0719ff9-4a3f-47b4-9cb5-31037e878da7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.666197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0719ff9-4a3f-47b4-9cb5-31037e878da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.666472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0719ff9-4a3f-47b4-9cb5-31037e878da7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.674066 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0719ff9-4a3f-47b4-9cb5-31037e878da7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:59.675494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0719ff9-4a3f-47b4-9cb5-31037e878da7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b0719ff9-4a3f-47b4-9cb5-31037e878da7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:18:59.691236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:59.692305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:59.693311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:59.693311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:59.693311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:18:59.693311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:18:59.693311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:18:59.693311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:18:59.693311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:18:59.693311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:18:59.693311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:18:59.693311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:18:59.693311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 483/960] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jul 6 20:18:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:59.693937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e26aa-bd19-49ae-a1df-7a59a08a27b3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.694544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e26aa-bd19-49ae-a1df-7a59a08a27b3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.694544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e26aa-bd19-49ae-a1df-7a59a08a27b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.712805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f32e26aa-bd19-49ae-a1df-7a59a08a27b3 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:18:59.714049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f32e26aa-bd19-49ae-a1df-7a59a08a27b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:18:59.772013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5079b0-f7c3-46b4-90c3-c046bff56d0b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:59.794045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 484/961] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:18:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:18:59.795596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e26aa-bd19-49ae-a1df-7a59a08a27b3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:59.820331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c226138-5764-4cf6-b0ab-a9ab825845bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:59.821068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c226138-5764-4cf6-b0ab-a9ab825845bd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.821402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c226138-5764-4cf6-b0ab-a9ab825845bd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.821675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c226138-5764-4cf6-b0ab-a9ab825845bd None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.825349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c226138-5764-4cf6-b0ab-a9ab825845bd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:59.825662 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c226138-5764-4cf6-b0ab-a9ab825845bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:59.827055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c226138-5764-4cf6-b0ab-a9ab825845bd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:59.832267 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 478/962] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:18:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:59.833176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c226138-5764-4cf6-b0ab-a9ab825845bd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:59.852229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:59.906994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e26aa-bd19-49ae-a1df-7a59a08a27b3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:59.925051 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:18:59.936329 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c226138-5764-4cf6-b0ab-a9ab825845bd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:18:59.943376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595adaa-e748-4b8e-a27c-3bd1b1033ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:59.944051 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595adaa-e748-4b8e-a27c-3bd1b1033ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.944318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595adaa-e748-4b8e-a27c-3bd1b1033ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.944585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595adaa-e748-4b8e-a27c-3bd1b1033ab7 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.945473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595adaa-e748-4b8e-a27c-3bd1b1033ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:18:59.945784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595adaa-e748-4b8e-a27c-3bd1b1033ab7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:59.947206 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595adaa-e748-4b8e-a27c-3bd1b1033ab7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:59.964999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 485/963] 10.222.0.30 () {56 vars in 1149 bytes} [Wed Jul 6 20:18:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:18:59.964999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595adaa-e748-4b8e-a27c-3bd1b1033ab7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:18:59.976158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18389ef0-8e51-4704-ae60-96de1d6cb578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:18:59.976985 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389ef0-8e51-4704-ae60-96de1d6cb578 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:18:59.977272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389ef0-8e51-4704-ae60-96de1d6cb578 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:18:59.977542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389ef0-8e51-4704-ae60-96de1d6cb578 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:18:59.978202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18389ef0-8e51-4704-ae60-96de1d6cb578 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:18:59.979558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18389ef0-8e51-4704-ae60-96de1d6cb578 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-18389ef0-8e51-4704-ae60-96de1d6cb578 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:18:59.991382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:18:59.992379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:18:59.993263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 479/964] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jul 6 20:18:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:18:59.994443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18389ef0-8e51-4704-ae60-96de1d6cb578 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:00.069752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595adaa-e748-4b8e-a27c-3bd1b1033ab7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:00.077304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:00.096782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18389ef0-8e51-4704-ae60-96de1d6cb578 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:00.104283 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045ad90-104c-4029-b7e1-807c84c79775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:00.104941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045ad90-104c-4029-b7e1-807c84c79775 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:00.105243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045ad90-104c-4029-b7e1-807c84c79775 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:00.105516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045ad90-104c-4029-b7e1-807c84c79775 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:00.106213 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045ad90-104c-4029-b7e1-807c84c79775 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:00.106513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045ad90-104c-4029-b7e1-807c84c79775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:00.107864 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045ad90-104c-4029-b7e1-807c84c79775 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:00.112673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 486/965] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:18:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:00.113492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045ad90-104c-4029-b7e1-807c84c79775 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:00.143609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215e144-0b1d-400a-923d-fe5d708ccb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:00.144637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215e144-0b1d-400a-923d-fe5d708ccb0e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:00.145167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215e144-0b1d-400a-923d-fe5d708ccb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:00.145741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215e144-0b1d-400a-923d-fe5d708ccb0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:00.175392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:00.239621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215e144-0b1d-400a-923d-fe5d708ccb0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:00.241173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215e144-0b1d-400a-923d-fe5d708ccb0e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:00.256237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045ad90-104c-4029-b7e1-807c84c79775 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:00.303901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d612f-986f-4177-9de5-31529566d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:00.304585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d612f-986f-4177-9de5-31529566d7bc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:00.304867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d612f-986f-4177-9de5-31529566d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:00.305172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d612f-986f-4177-9de5-31529566d7bc None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:00.305894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d612f-986f-4177-9de5-31529566d7bc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:00.306199 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d612f-986f-4177-9de5-31529566d7bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:00.307695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d612f-986f-4177-9de5-31529566d7bc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:00.313572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 487/966] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jul 6 20:19:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:00.319511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d612f-986f-4177-9de5-31529566d7bc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:00.338186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:00.363081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 480/967] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:18:59 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:19:00.370010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215e144-0b1d-400a-923d-fe5d708ccb0e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:00.432099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d612f-986f-4177-9de5-31529566d7bc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:00.434763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:00.469701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573342-ff01-4780-a6b9-dca44edb8f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:00.470502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573342-ff01-4780-a6b9-dca44edb8f34 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:00.470725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573342-ff01-4780-a6b9-dca44edb8f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:00.471009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573342-ff01-4780-a6b9-dca44edb8f34 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:00.471716 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2573342-ff01-4780-a6b9-dca44edb8f34 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:00.472022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2573342-ff01-4780-a6b9-dca44edb8f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:00.473851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2573342-ff01-4780-a6b9-dca44edb8f34 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:00.479428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 488/968] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jul 6 20:19:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:00.480192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215e144-0b1d-400a-923d-fe5d708ccb0e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:00.485141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573342-ff01-4780-a6b9-dca44edb8f34 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:00.518192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a978b-27b5-4680-864d-54421e4b2b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:00.519377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a978b-27b5-4680-864d-54421e4b2b1b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:00.519880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a978b-27b5-4680-864d-54421e4b2b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:00.520408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a978b-27b5-4680-864d-54421e4b2b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:00.532151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a978b-27b5-4680-864d-54421e4b2b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:00.534127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a978b-27b5-4680-864d-54421e4b2b1b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-053a978b-27b5-4680-864d-54421e4b2b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:19:00.553531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:00.554576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:00.555488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:19:00.555488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:19:00.555488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:00.555488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:00.562422 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 481/969] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:00.563602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a978b-27b5-4680-864d-54421e4b2b1b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:00.590074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573342-ff01-4780-a6b9-dca44edb8f34 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:00.601942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:00.628547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c62dc-7dac-41b4-ae26-8a41dbf60d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:00.629275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c62dc-7dac-41b4-ae26-8a41dbf60d95 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:00.629684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c62dc-7dac-41b4-ae26-8a41dbf60d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:00.629956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c62dc-7dac-41b4-ae26-8a41dbf60d95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:00.630704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c62dc-7dac-41b4-ae26-8a41dbf60d95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:00.632445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c62dc-7dac-41b4-ae26-8a41dbf60d95 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:00.653752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 489/970] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Jul 6 20:19:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:19:00.692221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a978b-27b5-4680-864d-54421e4b2b1b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:00.712255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5748-3ea1-4e65-9c97-8814ad2bf657 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:00.712603 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5748-3ea1-4e65-9c97-8814ad2bf657 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:00.712806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5748-3ea1-4e65-9c97-8814ad2bf657 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:00.714668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 490/971] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:19:00.720635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05fb67-6dc8-4d1b-a49b-5055814b80ff None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:00.720833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05fb67-6dc8-4d1b-a49b-5055814b80ff None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:00.721076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05fb67-6dc8-4d1b-a49b-5055814b80ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:00.742467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-df05fb67-6dc8-4d1b-a49b-5055814b80ff None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:00.743726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-df05fb67-6dc8-4d1b-a49b-5055814b80ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:00.744026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93822e60-0b94-4bfc-8bc0-08162f32d262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:00.744950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93822e60-0b94-4bfc-8bc0-08162f32d262 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:00.745472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93822e60-0b94-4bfc-8bc0-08162f32d262 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:00.746090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93822e60-0b94-4bfc-8bc0-08162f32d262 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:00.747199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93822e60-0b94-4bfc-8bc0-08162f32d262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:00.747607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93822e60-0b94-4bfc-8bc0-08162f32d262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:00.749280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93822e60-0b94-4bfc-8bc0-08162f32d262 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:00.764521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 482/972] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:00.769927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93822e60-0b94-4bfc-8bc0-08162f32d262 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:00.772216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:00.847873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 491/973] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:19:00.872076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05fb67-6dc8-4d1b-a49b-5055814b80ff None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:00.886288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:00.898998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93822e60-0b94-4bfc-8bc0-08162f32d262 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:00.943205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87001b4b-8dbe-47a7-b21b-c7b221727839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:00.944029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87001b4b-8dbe-47a7-b21b-c7b221727839 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:00.944285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87001b4b-8dbe-47a7-b21b-c7b221727839 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:00.944563 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87001b4b-8dbe-47a7-b21b-c7b221727839 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:00.951881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87001b4b-8dbe-47a7-b21b-c7b221727839 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:00.953361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87001b4b-8dbe-47a7-b21b-c7b221727839 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-87001b4b-8dbe-47a7-b21b-c7b221727839 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:19:00.968235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:00.969240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:00.970142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:19:00.970142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:19:00.970142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:19:00.970142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:19:00.970142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:19:00.970142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:19:00.970142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:19:00.970142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:00.970142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 483/974] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:19:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:19:00.977764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87001b4b-8dbe-47a7-b21b-c7b221727839 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:01.004204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05fb67-6dc8-4d1b-a49b-5055814b80ff None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:01.048650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08075442-48ed-48cc-a18d-574c103870ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:01.049866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075442-48ed-48cc-a18d-574c103870ca None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:01.050161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075442-48ed-48cc-a18d-574c103870ca None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:01.050440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075442-48ed-48cc-a18d-574c103870ca None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:01.051158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08075442-48ed-48cc-a18d-574c103870ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:01.052969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08075442-48ed-48cc-a18d-574c103870ca None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:01.072503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.sql.core [None req-08075442-48ed-48cc-a18d-574c103870ca None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 20:19:01.072503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 06 20:19:01.072503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [parameters: {'user_id': 'bc60630340ef4de88e0c6334017d4152', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 06 20:19:01.072503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80332) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-08075442-48ed-48cc-a18d-574c103870ca None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 06 20:19:01.079931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:19:01.080858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application yield resource Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise self.value Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application session.commit() Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 20:19:01.087324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.flush() Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application compat.raise_( Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 20:19:01.088234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:19:01.089897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:19:01.092047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bc60630340ef4de88e0c6334017d4152', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:01.094310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 06 20:19:01.096186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 06 20:19:01.098831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 06 20:19:01.098831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 06 20:19:01.098831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 20:19:01.098831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 20:19:01.098831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 06 20:19:01.098831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:01.098831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 492/975] 10.222.0.30 () {60 vars in 1131 bytes} [Wed Jul 6 20:19:00 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:01.098831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08075442-48ed-48cc-a18d-574c103870ca None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:01.115310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87001b4b-8dbe-47a7-b21b-c7b221727839 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:01.119581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:01.151556 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b84e2-116d-40d4-8641-c651a439eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:01.152136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b84e2-116d-40d4-8641-c651a439eedf None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:01.152417 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b84e2-116d-40d4-8641-c651a439eedf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:01.152692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b84e2-116d-40d4-8641-c651a439eedf None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:01.153533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b84e2-116d-40d4-8641-c651a439eedf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:01.153823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b84e2-116d-40d4-8641-c651a439eedf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:01.155274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b84e2-116d-40d4-8641-c651a439eedf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:01.167888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 484/976] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:19:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:01.174395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b84e2-116d-40d4-8641-c651a439eedf None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:01.191676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:01.224305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08075442-48ed-48cc-a18d-574c103870ca None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:01.270729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff5e38-0233-481e-b034-913880fecaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:01.271786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff5e38-0233-481e-b034-913880fecaaf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:01.272239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff5e38-0233-481e-b034-913880fecaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:01.272656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff5e38-0233-481e-b034-913880fecaaf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:01.283960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff5e38-0233-481e-b034-913880fecaaf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:01.284863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b84e2-116d-40d4-8641-c651a439eedf None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:01.286161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff5e38-0233-481e-b034-913880fecaaf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-12ff5e38-0233-481e-b034-913880fecaaf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:19:01.306038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:01.307257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:01.308421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:01.308421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:01.308421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:19:01.308421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:19:01.308421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:19:01.308421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:19:01.308421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:19:01.308421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:19:01.308421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:19:01.308421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:01.315991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 493/977] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:19:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:01.317644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff5e38-0233-481e-b034-913880fecaaf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:01.329083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1522ba1-b2d0-43af-900a-362680596b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:01.330498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1522ba1-b2d0-43af-900a-362680596b3a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:01.330498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1522ba1-b2d0-43af-900a-362680596b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:01.330896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1522ba1-b2d0-43af-900a-362680596b3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:01.331898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1522ba1-b2d0-43af-900a-362680596b3a None admin] RBAC: Adding query filter params (role.id=c52265f4bfdd4b54a2401176941d60f8, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=d869f947e5b14979b7f44aa19be9ae50) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:01.332298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1522ba1-b2d0-43af-900a-362680596b3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:01.333995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1522ba1-b2d0-43af-900a-362680596b3a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:01.349083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 485/978] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:19:01 2022] GET /identity/v3/role_assignments?user.id=d869f947e5b14979b7f44aa19be9ae50&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=c52265f4bfdd4b54a2401176941d60f8 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:01.415221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:01.440350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff5e38-0233-481e-b034-913880fecaaf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:01.476320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e904e-4034-470f-ac73-24249794d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:01.477116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e904e-4034-470f-ac73-24249794d66d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:01.477397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e904e-4034-470f-ac73-24249794d66d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:01.477667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e904e-4034-470f-ac73-24249794d66d None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:01.478486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e904e-4034-470f-ac73-24249794d66d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:01.478793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e904e-4034-470f-ac73-24249794d66d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:01.480233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e904e-4034-470f-ac73-24249794d66d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:01.522101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 494/979] 10.222.0.30 () {56 vars in 1101 bytes} [Wed Jul 6 20:19:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:02.216508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02708d2d-5c60-4b05-bd76-db1f439e876f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:02.217256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02708d2d-5c60-4b05-bd76-db1f439e876f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:02.217256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02708d2d-5c60-4b05-bd76-db1f439e876f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:02.218449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 486/980] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:02.224110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd5b29-1534-4f55-b383-95202305d73c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:02.224520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd5b29-1534-4f55-b383-95202305d73c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:02.224688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd5b29-1534-4f55-b383-95202305d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:02.242513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-43dd5b29-1534-4f55-b383-95202305d73c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:02.244054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-43dd5b29-1534-4f55-b383-95202305d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:02.316295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 495/981] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:02.338891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02708d2d-5c60-4b05-bd76-db1f439e876f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:02.422130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:02.450097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02708d2d-5c60-4b05-bd76-db1f439e876f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:02.484813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20bb91-7101-4edf-a0ff-83bf1264c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:02.485427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20bb91-7101-4edf-a0ff-83bf1264c52a None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:02.485708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20bb91-7101-4edf-a0ff-83bf1264c52a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:02.485970 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20bb91-7101-4edf-a0ff-83bf1264c52a None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:02.486707 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20bb91-7101-4edf-a0ff-83bf1264c52a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:02.488088 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20bb91-7101-4edf-a0ff-83bf1264c52a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:02.503594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 487/982] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:19:02 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:19:02.750301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b014a2-61b4-4a19-9977-066d7e32ae64 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:02.750477 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b014a2-61b4-4a19-9977-066d7e32ae64 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:02.750757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b014a2-61b4-4a19-9977-066d7e32ae64 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:02.752161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 496/983] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:02.757984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ee78-55f1-4f47-b0b0-35d4e96b2c92 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:02.758272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ee78-55f1-4f47-b0b0-35d4e96b2c92 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:02.758511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ee78-55f1-4f47-b0b0-35d4e96b2c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:02.776089 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0610ee78-55f1-4f47-b0b0-35d4e96b2c92 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:02.777300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0610ee78-55f1-4f47-b0b0-35d4e96b2c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:02.863450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 488/984] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:02.887126 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b014a2-61b4-4a19-9977-066d7e32ae64 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:02.954734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:02.996443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b014a2-61b4-4a19-9977-066d7e32ae64 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:03.032116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28d352-889c-485a-8a5e-d3e87151ab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:03.033016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28d352-889c-485a-8a5e-d3e87151ab2c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:03.033437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28d352-889c-485a-8a5e-d3e87151ab2c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:03.033803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28d352-889c-485a-8a5e-d3e87151ab2c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:03.034634 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28d352-889c-485a-8a5e-d3e87151ab2c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:03.036182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28d352-889c-485a-8a5e-d3e87151ab2c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3e28d352-889c-485a-8a5e-d3e87151ab2c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:03.050492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:03.051613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:19:03.052577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:03.057396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 497/985] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jul 6 20:19:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:03.058730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610ee78-55f1-4f47-b0b0-35d4e96b2c92 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:03.120373 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:03.165280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610ee78-55f1-4f47-b0b0-35d4e96b2c92 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:03.201131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fb86a-0f14-42d8-9c19-3ddbdef6d128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:03.201801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fb86a-0f14-42d8-9c19-3ddbdef6d128 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:03.202079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fb86a-0f14-42d8-9c19-3ddbdef6d128 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:03.202347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fb86a-0f14-42d8-9c19-3ddbdef6d128 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:03.203053 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fb86a-0f14-42d8-9c19-3ddbdef6d128 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:03.203355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fb86a-0f14-42d8-9c19-3ddbdef6d128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:03.204731 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fb86a-0f14-42d8-9c19-3ddbdef6d128 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:03.210266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 489/986] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jul 6 20:19:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:03.215983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28d352-889c-485a-8a5e-d3e87151ab2c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:03.315617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28d352-889c-485a-8a5e-d3e87151ab2c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:03.340897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:03.350073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28db0a-e546-4cdd-90de-a7a4cdc7d228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:03.350741 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28db0a-e546-4cdd-90de-a7a4cdc7d228 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:03.351016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28db0a-e546-4cdd-90de-a7a4cdc7d228 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:03.351277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28db0a-e546-4cdd-90de-a7a4cdc7d228 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:03.351982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28db0a-e546-4cdd-90de-a7a4cdc7d228 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:03.352285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28db0a-e546-4cdd-90de-a7a4cdc7d228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:03.353666 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28db0a-e546-4cdd-90de-a7a4cdc7d228 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:03.358779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 498/987] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jul 6 20:19:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:03.364687 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fb86a-0f14-42d8-9c19-3ddbdef6d128 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:03.428787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347ef0-68e6-4f75-b47b-55ff93186f90 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:03.429143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347ef0-68e6-4f75-b47b-55ff93186f90 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:03.429396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347ef0-68e6-4f75-b47b-55ff93186f90 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:03.431076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 499/988] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:03.435698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02defb6-069d-4f76-b087-bb51a96a5e36 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:03.435992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02defb6-069d-4f76-b087-bb51a96a5e36 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:03.436264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02defb6-069d-4f76-b087-bb51a96a5e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:03.453430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c02defb6-069d-4f76-b087-bb51a96a5e36 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:03.454605 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c02defb6-069d-4f76-b087-bb51a96a5e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:03.467696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fb86a-0f14-42d8-9c19-3ddbdef6d128 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:03.492397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:03.505274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2599b-7ec7-430a-9033-f2ba9c57cd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:03.506297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2599b-7ec7-430a-9033-f2ba9c57cd30 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:03.506575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2599b-7ec7-430a-9033-f2ba9c57cd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:03.506845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2599b-7ec7-430a-9033-f2ba9c57cd30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:03.507756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2599b-7ec7-430a-9033-f2ba9c57cd30 None admin] RBAC: Adding query filter params (interface=admin, service_id=7f86f73d04914a18832da37c1372d192, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:03.508082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2599b-7ec7-430a-9033-f2ba9c57cd30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:03.509462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2599b-7ec7-430a-9033-f2ba9c57cd30 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:03.515081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 490/989] 10.222.0.30 () {56 vars in 1249 bytes} [Wed Jul 6 20:19:03 2022] GET /identity/v3/endpoints?service_id=7f86f73d04914a18832da37c1372d192&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:03.520459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2599b-7ec7-430a-9033-f2ba9c57cd30 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:03.521856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 500/990] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:19:03.546147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02defb6-069d-4f76-b087-bb51a96a5e36 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:03.646446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2599b-7ec7-430a-9033-f2ba9c57cd30 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:03.665136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02defb6-069d-4f76-b087-bb51a96a5e36 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:03.682769 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b289b-4a41-4afa-b6ca-9377a014e8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:03.683677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b289b-4a41-4afa-b6ca-9377a014e8ff None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:03.684101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b289b-4a41-4afa-b6ca-9377a014e8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:03.684534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b289b-4a41-4afa-b6ca-9377a014e8ff None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:03.685460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b289b-4a41-4afa-b6ca-9377a014e8ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:03.687014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b289b-4a41-4afa-b6ca-9377a014e8ff None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:03.689267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:03.694034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 491/991] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Jul 6 20:19:03 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:19:03.714723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8dc07-d2b4-498a-86ef-84c611ef3340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:03.715682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8dc07-d2b4-498a-86ef-84c611ef3340 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:03.716034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8dc07-d2b4-498a-86ef-84c611ef3340 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:03.716375 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8dc07-d2b4-498a-86ef-84c611ef3340 None admin] PATH_INFO: `/v3/services/image` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:03.717159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8dc07-d2b4-498a-86ef-84c611ef3340 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:03.718958 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8dc07-d2b4-498a-86ef-84c611ef3340 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f6a8dc07-d2b4-498a-86ef-84c611ef3340 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:03.734394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:03.735524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:03.736467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 501/992] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Jul 6 20:19:03 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:19:03.742103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b289b-4a41-4afa-b6ca-9377a014e8ff None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:03.828686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:03.880596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b289b-4a41-4afa-b6ca-9377a014e8ff None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:03.917058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fa442-e55a-4273-a8dc-1906147e7544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:03.917625 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa442-e55a-4273-a8dc-1906147e7544 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:03.917909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa442-e55a-4273-a8dc-1906147e7544 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:03.918184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa442-e55a-4273-a8dc-1906147e7544 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:03.918895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fa442-e55a-4273-a8dc-1906147e7544 None admin] RBAC: Adding query filter params (name=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:03.919200 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fa442-e55a-4273-a8dc-1906147e7544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:03.920853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fa442-e55a-4273-a8dc-1906147e7544 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:03.926134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 492/993] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:03.931868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8dc07-d2b4-498a-86ef-84c611ef3340 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:04.034838 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8dc07-d2b4-498a-86ef-84c611ef3340 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:04.070525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abf129-e26f-4690-b6b0-64c7fe79253c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:04.071217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf129-e26f-4690-b6b0-64c7fe79253c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:04.071499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf129-e26f-4690-b6b0-64c7fe79253c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:04.071777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf129-e26f-4690-b6b0-64c7fe79253c None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:04.072509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abf129-e26f-4690-b6b0-64c7fe79253c None admin] RBAC: Adding query filter params (type=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:04.072819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abf129-e26f-4690-b6b0-64c7fe79253c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:04.074234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abf129-e26f-4690-b6b0-64c7fe79253c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:04.079007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 502/994] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:04.572192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe59ae7-2b9b-41b1-8379-d814cc8e373b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:04.572784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe59ae7-2b9b-41b1-8379-d814cc8e373b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:04.572784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe59ae7-2b9b-41b1-8379-d814cc8e373b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:04.575048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 493/995] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:04.580271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837408e-f4e1-4bc2-9628-86458f83886b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:04.580722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837408e-f4e1-4bc2-9628-86458f83886b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:04.580801 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837408e-f4e1-4bc2-9628-86458f83886b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:04.603314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8837408e-f4e1-4bc2-9628-86458f83886b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:04.604511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8837408e-f4e1-4bc2-9628-86458f83886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:04.661784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:04.686338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 503/996] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:04.711333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe59ae7-2b9b-41b1-8379-d814cc8e373b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:04.844800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe59ae7-2b9b-41b1-8379-d814cc8e373b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:04.868780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:04.895143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d4c76-f42c-406c-9473-8e67ca82a39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:04.895966 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d4c76-f42c-406c-9473-8e67ca82a39a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:04.896396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d4c76-f42c-406c-9473-8e67ca82a39a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:04.896897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d4c76-f42c-406c-9473-8e67ca82a39a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:04.898165 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d4c76-f42c-406c-9473-8e67ca82a39a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:04.900047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d4c76-f42c-406c-9473-8e67ca82a39a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-868d4c76-f42c-406c-9473-8e67ca82a39a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:04.916539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:04.917901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:19:04.918766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:04.921342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 494/997] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:19:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:04.925387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837408e-f4e1-4bc2-9628-86458f83886b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:05.035718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837408e-f4e1-4bc2-9628-86458f83886b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:05.073200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa312446-9437-4a51-b1c1-02ef8fbe7197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:05.073873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa312446-9437-4a51-b1c1-02ef8fbe7197 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:05.074154 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa312446-9437-4a51-b1c1-02ef8fbe7197 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:05.074492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa312446-9437-4a51-b1c1-02ef8fbe7197 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:05.075222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa312446-9437-4a51-b1c1-02ef8fbe7197 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:05.075530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa312446-9437-4a51-b1c1-02ef8fbe7197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:05.077053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa312446-9437-4a51-b1c1-02ef8fbe7197 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:05.082351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 504/998] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:19:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:05.088305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d4c76-f42c-406c-9473-8e67ca82a39a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:05.197237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d4c76-f42c-406c-9473-8e67ca82a39a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:05.238289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1100f-075f-462c-87f2-b3c2422354db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:05.239030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1100f-075f-462c-87f2-b3c2422354db None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:05.239313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1100f-075f-462c-87f2-b3c2422354db None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:05.239545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1100f-075f-462c-87f2-b3c2422354db None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:05.240301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1100f-075f-462c-87f2-b3c2422354db None admin] RBAC: Adding query filter params (type=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:05.240611 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1100f-075f-462c-87f2-b3c2422354db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:05.242043 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1100f-075f-462c-87f2-b3c2422354db None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:05.247723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 495/999] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:19:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:05.254368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa312446-9437-4a51-b1c1-02ef8fbe7197 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:05.302654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:05.356676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa312446-9437-4a51-b1c1-02ef8fbe7197 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:05.395403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e442-2d5f-4c84-893a-717be11b9161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:05.395403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e442-2d5f-4c84-893a-717be11b9161 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:05.395403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e442-2d5f-4c84-893a-717be11b9161 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:05.395403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e442-2d5f-4c84-893a-717be11b9161 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:05.395844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e442-2d5f-4c84-893a-717be11b9161 None admin] RBAC: Adding query filter params (interface=public, service_id=226da92996844ab595dc8cbe4d53365a, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:05.395844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e442-2d5f-4c84-893a-717be11b9161 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:05.395844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e442-2d5f-4c84-893a-717be11b9161 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:05.400280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 505/1000] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Jul 6 20:19:05 2022] GET /identity/v3/endpoints?service_id=226da92996844ab595dc8cbe4d53365a&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:05.405641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1100f-075f-462c-87f2-b3c2422354db None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:05.452443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:05.511083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1100f-075f-462c-87f2-b3c2422354db None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:05.548062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf0f2e-ceed-41aa-8980-1da48a889e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:05.548737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0f2e-ceed-41aa-8980-1da48a889e92 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:05.549046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0f2e-ceed-41aa-8980-1da48a889e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:05.549332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0f2e-ceed-41aa-8980-1da48a889e92 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:05.550020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf0f2e-ceed-41aa-8980-1da48a889e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:05.551452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf0f2e-ceed-41aa-8980-1da48a889e92 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:05.558195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 496/1001] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Jul 6 20:19:05 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:19:05.785088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a929-1918-4b99-8928-54c940ce3666 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:05.785729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a929-1918-4b99-8928-54c940ce3666 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:05.785729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a929-1918-4b99-8928-54c940ce3666 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:05.787284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 506/1002] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:05.792646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2451-df6e-4843-b300-7a349cd60ac4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:05.793155 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2451-df6e-4843-b300-7a349cd60ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:05.793333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2451-df6e-4843-b300-7a349cd60ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:05.813684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-34bc2451-df6e-4843-b300-7a349cd60ac4 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:05.814869 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-34bc2451-df6e-4843-b300-7a349cd60ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:05.917593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 497/1003] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:19:05.940666 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213a929-1918-4b99-8928-54c940ce3666 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:06.045577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213a929-1918-4b99-8928-54c940ce3666 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:06.055526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:06.082888 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585efa6-dd9e-4ed0-8ce2-4ef861c932eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:06.083704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585efa6-dd9e-4ed0-8ce2-4ef861c932eb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:06.083983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585efa6-dd9e-4ed0-8ce2-4ef861c932eb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:06.084246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585efa6-dd9e-4ed0-8ce2-4ef861c932eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:06.084904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585efa6-dd9e-4ed0-8ce2-4ef861c932eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:06.086289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585efa6-dd9e-4ed0-8ce2-4ef861c932eb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0585efa6-dd9e-4ed0-8ce2-4ef861c932eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:06.098474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:06.099491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:06.105717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 507/1004] 10.222.0.30 () {56 vars in 1126 bytes} [Wed Jul 6 20:19:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:06.108215 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc2451-df6e-4843-b300-7a349cd60ac4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:06.151017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:06.164615 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb3f4-7727-4ee7-9ffe-311cd6058e8f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:06.164898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb3f4-7727-4ee7-9ffe-311cd6058e8f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:06.165203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb3f4-7727-4ee7-9ffe-311cd6058e8f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:06.166718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 508/1005] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:06.171434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074cb3-e90e-4dce-a1ef-f46eacffa347 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:06.171722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074cb3-e90e-4dce-a1ef-f46eacffa347 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:06.172001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074cb3-e90e-4dce-a1ef-f46eacffa347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:06.188783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-37074cb3-e90e-4dce-a1ef-f46eacffa347 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:06.189993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-37074cb3-e90e-4dce-a1ef-f46eacffa347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:06.218533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc2451-df6e-4843-b300-7a349cd60ac4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:06.255152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1a7a4-f84b-4f39-8fae-e684443ec4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:06.256201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a7a4-f84b-4f39-8fae-e684443ec4bc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:06.256480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a7a4-f84b-4f39-8fae-e684443ec4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:06.256753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a7a4-f84b-4f39-8fae-e684443ec4bc None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:06.257500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1a7a4-f84b-4f39-8fae-e684443ec4bc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:06.257810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1a7a4-f84b-4f39-8fae-e684443ec4bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:06.259176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1a7a4-f84b-4f39-8fae-e684443ec4bc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:06.260655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 509/1006] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:19:06.268857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 498/1007] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jul 6 20:19:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:06.270031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37074cb3-e90e-4dce-a1ef-f46eacffa347 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:06.284333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1a7a4-f84b-4f39-8fae-e684443ec4bc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:06.370493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37074cb3-e90e-4dce-a1ef-f46eacffa347 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:06.371928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:06.393281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1a7a4-f84b-4f39-8fae-e684443ec4bc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:06.395315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:06.406508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ff48e-0497-40b2-98f6-eae4f4261a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:06.407197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff48e-0497-40b2-98f6-eae4f4261a77 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:06.407475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff48e-0497-40b2-98f6-eae4f4261a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:06.408051 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff48e-0497-40b2-98f6-eae4f4261a77 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:06.408767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ff48e-0497-40b2-98f6-eae4f4261a77 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:06.409116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ff48e-0497-40b2-98f6-eae4f4261a77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:06.410523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ff48e-0497-40b2-98f6-eae4f4261a77 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:06.419985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 510/1008] 10.222.0.30 () {56 vars in 1122 bytes} [Wed Jul 6 20:19:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:06.420940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ff48e-0497-40b2-98f6-eae4f4261a77 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:06.435127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb274e0-f538-40e4-9bcf-ba0a06d3fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:06.435814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb274e0-f538-40e4-9bcf-ba0a06d3fe44 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:06.436092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb274e0-f538-40e4-9bcf-ba0a06d3fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:06.436646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb274e0-f538-40e4-9bcf-ba0a06d3fe44 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:06.437121 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb274e0-f538-40e4-9bcf-ba0a06d3fe44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:06.438487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb274e0-f538-40e4-9bcf-ba0a06d3fe44 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:06.452810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 499/1009] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:19:06 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:19:06.537158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ff48e-0497-40b2-98f6-eae4f4261a77 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:06.581194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8203b-a576-42e1-a390-b39f6035ee4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:06.581860 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8203b-a576-42e1-a390-b39f6035ee4e None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:06.582137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8203b-a576-42e1-a390-b39f6035ee4e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:06.582450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8203b-a576-42e1-a390-b39f6035ee4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:06.583193 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8203b-a576-42e1-a390-b39f6035ee4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:06.584586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8203b-a576-42e1-a390-b39f6035ee4e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:06.608388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 511/1010] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Jul 6 20:19:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:19:07.599691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e257-5d61-4032-ab28-11d0de7f1707 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:07.600291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e257-5d61-4032-ab28-11d0de7f1707 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:07.600371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e257-5d61-4032-ab28-11d0de7f1707 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:07.602002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 500/1011] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:07.607240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ae8c6-5c04-4da2-9f0e-95773d9a899c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:07.607675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ae8c6-5c04-4da2-9f0e-95773d9a899c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:07.607763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ae8c6-5c04-4da2-9f0e-95773d9a899c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:07.626257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2d6ae8c6-5c04-4da2-9f0e-95773d9a899c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:07.627472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2d6ae8c6-5c04-4da2-9f0e-95773d9a899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:07.647983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:07.716220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 512/1012] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:07 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:07.745858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e257-5d61-4032-ab28-11d0de7f1707 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:07.866027 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e257-5d61-4032-ab28-11d0de7f1707 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:07.903693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d39e2-0e38-4c18-b1ac-64e775ecec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:07.904511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d39e2-0e38-4c18-b1ac-64e775ecec28 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:07.904812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d39e2-0e38-4c18-b1ac-64e775ecec28 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:07.905110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d39e2-0e38-4c18-b1ac-64e775ecec28 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:07.905771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d39e2-0e38-4c18-b1ac-64e775ecec28 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:07.907168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d39e2-0e38-4c18-b1ac-64e775ecec28 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0d4d39e2-0e38-4c18-b1ac-64e775ecec28 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:07.919145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:07.920178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:07.926178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 501/1013] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:19:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:07.929939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ae8c6-5c04-4da2-9f0e-95773d9a899c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:08.036732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ae8c6-5c04-4da2-9f0e-95773d9a899c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:08.073186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa4843-4703-450f-a5b1-19eb8ec695cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:08.073873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa4843-4703-450f-a5b1-19eb8ec695cc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:08.074154 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa4843-4703-450f-a5b1-19eb8ec695cc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:08.074432 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa4843-4703-450f-a5b1-19eb8ec695cc None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:08.075148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa4843-4703-450f-a5b1-19eb8ec695cc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:08.075457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa4843-4703-450f-a5b1-19eb8ec695cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:08.076862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa4843-4703-450f-a5b1-19eb8ec695cc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:08.086912 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 513/1014] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:19:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:08.088132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d39e2-0e38-4c18-b1ac-64e775ecec28 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:08.117364 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:08.195591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d39e2-0e38-4c18-b1ac-64e775ecec28 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:08.233209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff94c1-ad80-4eb5-91db-458dbcf90514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:08.233884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff94c1-ad80-4eb5-91db-458dbcf90514 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:08.234164 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff94c1-ad80-4eb5-91db-458dbcf90514 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:08.234445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff94c1-ad80-4eb5-91db-458dbcf90514 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:08.235174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff94c1-ad80-4eb5-91db-458dbcf90514 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:08.235481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff94c1-ad80-4eb5-91db-458dbcf90514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:08.236860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff94c1-ad80-4eb5-91db-458dbcf90514 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:08.242480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 502/1015] 10.222.0.30 () {56 vars in 1112 bytes} [Wed Jul 6 20:19:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:08.248091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa4843-4703-450f-a5b1-19eb8ec695cc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:08.264462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:08.357252 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa4843-4703-450f-a5b1-19eb8ec695cc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:08.394424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d635c87-0484-409b-9be7-939ec77bf9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:08.395082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d635c87-0484-409b-9be7-939ec77bf9f9 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:08.395441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d635c87-0484-409b-9be7-939ec77bf9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:08.395719 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d635c87-0484-409b-9be7-939ec77bf9f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:08.396493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d635c87-0484-409b-9be7-939ec77bf9f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:08.397897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d635c87-0484-409b-9be7-939ec77bf9f9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:08.418096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 514/1016] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Jul 6 20:19:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:19:08.556771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb36c3-98b5-47a7-b40d-2d63b9be6768 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:08.557212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb36c3-98b5-47a7-b40d-2d63b9be6768 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:08.557575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb36c3-98b5-47a7-b40d-2d63b9be6768 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:08.559129 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 503/1017] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:08.565333 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5e87-c35d-4a94-915a-b6ad2d3f2e4e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:08.565647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5e87-c35d-4a94-915a-b6ad2d3f2e4e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:08.565898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5e87-c35d-4a94-915a-b6ad2d3f2e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:08.585118 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5c2b5e87-c35d-4a94-915a-b6ad2d3f2e4e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:08.586297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5c2b5e87-c35d-4a94-915a-b6ad2d3f2e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:08.651408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:08.669302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 515/1018] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:08.687688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb36c3-98b5-47a7-b40d-2d63b9be6768 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:08.792659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:08.807291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb36c3-98b5-47a7-b40d-2d63b9be6768 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:08.819497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f33a07-b080-478f-91d5-08fcf7798feb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:08.819793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f33a07-b080-478f-91d5-08fcf7798feb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:08.820037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f33a07-b080-478f-91d5-08fcf7798feb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:08.826183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 516/1019] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:08.827940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e75cc-84ed-42cc-9cc4-10282c5920ca None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:08.828205 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e75cc-84ed-42cc-9cc4-10282c5920ca None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:08.828495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e75cc-84ed-42cc-9cc4-10282c5920ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:08.848476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-682e75cc-84ed-42cc-9cc4-10282c5920ca None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:08.849701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-682e75cc-84ed-42cc-9cc4-10282c5920ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:08.850329 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a0c28-31a0-4221-923e-13802ba01233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:08.851156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a0c28-31a0-4221-923e-13802ba01233 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:08.851446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a0c28-31a0-4221-923e-13802ba01233 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:08.851909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a0c28-31a0-4221-923e-13802ba01233 None admin] PATH_INFO: `/v3/services/image` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:08.853202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a0c28-31a0-4221-923e-13802ba01233 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:08.854618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a0c28-31a0-4221-923e-13802ba01233 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-045a0c28-31a0-4221-923e-13802ba01233 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:08.869667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:08.870768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:19:08.871630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:08.872424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 504/1020] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Jul 6 20:19:08 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:08.878239 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a0c28-31a0-4221-923e-13802ba01233 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:08.929253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 517/1021] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:19:08.955445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e75cc-84ed-42cc-9cc4-10282c5920ca None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:08.992935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a0c28-31a0-4221-923e-13802ba01233 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:09.031353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2e76e-46de-425f-b73d-a7eba27431ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:09.032030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2e76e-46de-425f-b73d-a7eba27431ef None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:09.032312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2e76e-46de-425f-b73d-a7eba27431ef None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:09.032589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2e76e-46de-425f-b73d-a7eba27431ef None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:09.033329 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2e76e-46de-425f-b73d-a7eba27431ef None admin] RBAC: Adding query filter params (name=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:09.033645 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2e76e-46de-425f-b73d-a7eba27431ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:09.035123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2e76e-46de-425f-b73d-a7eba27431ef None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:09.041077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 505/1022] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:09.046750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2e76e-46de-425f-b73d-a7eba27431ef None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:09.068358 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:09.072034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e75cc-84ed-42cc-9cc4-10282c5920ca None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:09.102026 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:09.115531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5183e-14e6-45b2-91ee-734274f9731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:09.116552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5183e-14e6-45b2-91ee-734274f9731f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:09.116835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5183e-14e6-45b2-91ee-734274f9731f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:09.117467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5183e-14e6-45b2-91ee-734274f9731f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:09.118969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5183e-14e6-45b2-91ee-734274f9731f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:09.121356 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5183e-14e6-45b2-91ee-734274f9731f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:09.123632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 518/1023] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:09.129772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5183e-14e6-45b2-91ee-734274f9731f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:09.174184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2e76e-46de-425f-b73d-a7eba27431ef None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:09.215196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac7c72-d2a5-4c79-b0c4-21905d7ebb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:09.215891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac7c72-d2a5-4c79-b0c4-21905d7ebb40 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:09.216169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac7c72-d2a5-4c79-b0c4-21905d7ebb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:09.216445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac7c72-d2a5-4c79-b0c4-21905d7ebb40 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:09.217201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac7c72-d2a5-4c79-b0c4-21905d7ebb40 None admin] RBAC: Adding query filter params (type=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:09.217504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac7c72-d2a5-4c79-b0c4-21905d7ebb40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:09.218909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac7c72-d2a5-4c79-b0c4-21905d7ebb40 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:09.224343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 506/1024] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:09.230057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac7c72-d2a5-4c79-b0c4-21905d7ebb40 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:09.243965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5183e-14e6-45b2-91ee-734274f9731f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:09.282389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b782db-a8f1-47f1-84be-8b5a94a216f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:09.283042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b782db-a8f1-47f1-84be-8b5a94a216f0 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:09.283320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b782db-a8f1-47f1-84be-8b5a94a216f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:09.283597 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b782db-a8f1-47f1-84be-8b5a94a216f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:09.284316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b782db-a8f1-47f1-84be-8b5a94a216f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:09.285788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b782db-a8f1-47f1-84be-8b5a94a216f0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:09.314198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 519/1025] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:19:09 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:19:09.340175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:09.363030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac7c72-d2a5-4c79-b0c4-21905d7ebb40 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:09.402149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ad224-63f4-4206-bca6-92867a3c838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:09.402837 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ad224-63f4-4206-bca6-92867a3c838e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:09.403113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ad224-63f4-4206-bca6-92867a3c838e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:09.403383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ad224-63f4-4206-bca6-92867a3c838e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:09.404206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ad224-63f4-4206-bca6-92867a3c838e None admin] RBAC: Adding query filter params (interface=public, service_id=7085e1fa074342ee9aff0cdbf7221116, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:09.404518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ad224-63f4-4206-bca6-92867a3c838e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:09.405956 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ad224-63f4-4206-bca6-92867a3c838e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:09.412059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 507/1026] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Jul 6 20:19:09 2022] GET /identity/v3/endpoints?service_id=7085e1fa074342ee9aff0cdbf7221116&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:09.419826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b782db-a8f1-47f1-84be-8b5a94a216f0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:09.475783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:09.536997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b782db-a8f1-47f1-84be-8b5a94a216f0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:09.573284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b28db-5951-4333-8936-f4e5b43e2381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:09.574126 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b28db-5951-4333-8936-f4e5b43e2381 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:09.574507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b28db-5951-4333-8936-f4e5b43e2381 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:09.574879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b28db-5951-4333-8936-f4e5b43e2381 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:09.575690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b28db-5951-4333-8936-f4e5b43e2381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:09.577277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b28db-5951-4333-8936-f4e5b43e2381 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:09.585070 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 520/1027] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Jul 6 20:19:09 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:19:10.727028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53191f48-369b-4068-9234-e2e51ac0e504 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:10.727570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53191f48-369b-4068-9234-e2e51ac0e504 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:10.727570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53191f48-369b-4068-9234-e2e51ac0e504 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:10.728993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 508/1028] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:10.734233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ded514-57a3-4e1e-81e1-9ef302ba1940 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:10.734667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ded514-57a3-4e1e-81e1-9ef302ba1940 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:10.734746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ded514-57a3-4e1e-81e1-9ef302ba1940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:10.752190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a3ded514-57a3-4e1e-81e1-9ef302ba1940 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:10.753413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a3ded514-57a3-4e1e-81e1-9ef302ba1940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:10.830563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 521/1029] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:10.853854 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53191f48-369b-4068-9234-e2e51ac0e504 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:10.960216 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53191f48-369b-4068-9234-e2e51ac0e504 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:10.996208 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689810c3-957c-474a-9bcd-29994aa1e6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:10.996979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689810c3-957c-474a-9bcd-29994aa1e6dd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:10.997260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689810c3-957c-474a-9bcd-29994aa1e6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:10.997518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689810c3-957c-474a-9bcd-29994aa1e6dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.008212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689810c3-957c-474a-9bcd-29994aa1e6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-689810c3-957c-474a-9bcd-29994aa1e6dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:19:11.016250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:11.017204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:11.023465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 509/1030] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jul 6 20:19:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:11.024177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ded514-57a3-4e1e-81e1-9ef302ba1940 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:11.064251 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:11.126013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ded514-57a3-4e1e-81e1-9ef302ba1940 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:11.163031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e040cb-6bd9-4f47-afda-52c0fa6af8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:11.163700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e040cb-6bd9-4f47-afda-52c0fa6af8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:11.163974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e040cb-6bd9-4f47-afda-52c0fa6af8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:11.164212 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e040cb-6bd9-4f47-afda-52c0fa6af8f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.164989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e040cb-6bd9-4f47-afda-52c0fa6af8f9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:11.165310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e040cb-6bd9-4f47-afda-52c0fa6af8f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:11.166672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e040cb-6bd9-4f47-afda-52c0fa6af8f9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:11.175752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 522/1031] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Jul 6 20:19:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:11.181396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689810c3-957c-474a-9bcd-29994aa1e6dd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:11.191091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:11.288281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689810c3-957c-474a-9bcd-29994aa1e6dd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:11.323576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52fba0-136c-4f14-80e0-85d81e87e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:11.324422 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52fba0-136c-4f14-80e0-85d81e87e400 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:11.324658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52fba0-136c-4f14-80e0-85d81e87e400 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:11.325017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52fba0-136c-4f14-80e0-85d81e87e400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.336092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52fba0-136c-4f14-80e0-85d81e87e400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:11.337581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52fba0-136c-4f14-80e0-85d81e87e400 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ef52fba0-136c-4f14-80e0-85d81e87e400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:19:11.354882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:11.355845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:11.356735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:19:11.356735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:19:11.356735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:11.356735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:11.362413 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 510/1032] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:11.362545 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e040cb-6bd9-4f47-afda-52c0fa6af8f9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:11.388060 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4960e40-6616-43c7-82da-dd555515bdde None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:11.388384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4960e40-6616-43c7-82da-dd555515bdde None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:11.388619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4960e40-6616-43c7-82da-dd555515bdde None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.390711 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 511/1033] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:11.395458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7abaf8-1b9e-40de-95e8-7594c63cb838 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:11.395846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7abaf8-1b9e-40de-95e8-7594c63cb838 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:11.396120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7abaf8-1b9e-40de-95e8-7594c63cb838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.413166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6a7abaf8-1b9e-40de-95e8-7594c63cb838 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:11.414333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6a7abaf8-1b9e-40de-95e8-7594c63cb838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:11.470110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:11.473254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:11.476826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e040cb-6bd9-4f47-afda-52c0fa6af8f9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:11.485480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 512/1034] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:19:11.510044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7abaf8-1b9e-40de-95e8-7594c63cb838 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:11.513729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39c6d8-a26f-4088-b04d-62f503e5ce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:11.513976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c6d8-a26f-4088-b04d-62f503e5ce46 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:11.514201 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c6d8-a26f-4088-b04d-62f503e5ce46 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:11.514475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c6d8-a26f-4088-b04d-62f503e5ce46 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.515204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39c6d8-a26f-4088-b04d-62f503e5ce46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:11.515515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39c6d8-a26f-4088-b04d-62f503e5ce46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:11.516886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39c6d8-a26f-4088-b04d-62f503e5ce46 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:11.529693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 523/1035] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:11.535372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39c6d8-a26f-4088-b04d-62f503e5ce46 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:11.627284 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7abaf8-1b9e-40de-95e8-7594c63cb838 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:11.636929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39c6d8-a26f-4088-b04d-62f503e5ce46 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:11.660566 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a3b50-48d1-4703-93f7-49f84db00060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:11.661399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3b50-48d1-4703-93f7-49f84db00060 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:11.661681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3b50-48d1-4703-93f7-49f84db00060 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:11.661955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3b50-48d1-4703-93f7-49f84db00060 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.663134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a3b50-48d1-4703-93f7-49f84db00060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:11.664575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a3b50-48d1-4703-93f7-49f84db00060 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:11.666243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 513/1036] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:11.667412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a5538-4fe1-4683-b571-4a4f8ef9305a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:11.667692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a5538-4fe1-4683-b571-4a4f8ef9305a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:11.667967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a5538-4fe1-4683-b571-4a4f8ef9305a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.669202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 514/1037] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:11.671779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a5538-4fe1-4683-b571-4a4f8ef9305a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:11.674751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee08b0-c3b3-4e9e-a50b-de31e01f1d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:11.675555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee08b0-c3b3-4e9e-a50b-de31e01f1d03 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:11.675899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee08b0-c3b3-4e9e-a50b-de31e01f1d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:11.676180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee08b0-c3b3-4e9e-a50b-de31e01f1d03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.683579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee08b0-c3b3-4e9e-a50b-de31e01f1d03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:11.685048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee08b0-c3b3-4e9e-a50b-de31e01f1d03 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-35ee08b0-c3b3-4e9e-a50b-de31e01f1d03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:19:11.699122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:11.700124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:11.701149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:11.701149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:11.701149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:19:11.701149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:19:11.701149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:19:11.701149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:19:11.701149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:19:11.701149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:19:11.701149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:19:11.701149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:11.705130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 524/1038] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Jul 6 20:19:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:11.706417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095309a-2b72-41c5-8623-d06e9ddb4ef6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:11.706701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095309a-2b72-41c5-8623-d06e9ddb4ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:11.707110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095309a-2b72-41c5-8623-d06e9ddb4ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.723675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c095309a-2b72-41c5-8623-d06e9ddb4ef6 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:11.724856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c095309a-2b72-41c5-8623-d06e9ddb4ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:11.732148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:11.739559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:11.781350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a5538-4fe1-4683-b571-4a4f8ef9305a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:11.800629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 525/1039] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:11.801501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095309a-2b72-41c5-8623-d06e9ddb4ef6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:11.821430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f12685-bec6-458a-9888-5b91836d1fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:11.822659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f12685-bec6-458a-9888-5b91836d1fa0 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:11.822946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f12685-bec6-458a-9888-5b91836d1fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:11.823221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f12685-bec6-458a-9888-5b91836d1fa0 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.823936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f12685-bec6-458a-9888-5b91836d1fa0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:11.825407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f12685-bec6-458a-9888-5b91836d1fa0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:11.846090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 515/1040] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:19:11 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:19:11.846888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f12685-bec6-458a-9888-5b91836d1fa0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:11.920988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095309a-2b72-41c5-8623-d06e9ddb4ef6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:11.956743 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc063eae-1b92-47a2-bc99-1203a21600c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:11.957535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc063eae-1b92-47a2-bc99-1203a21600c8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:11.957812 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc063eae-1b92-47a2-bc99-1203a21600c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:11.958085 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc063eae-1b92-47a2-bc99-1203a21600c8 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:11.958955 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc063eae-1b92-47a2-bc99-1203a21600c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:11.959266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc063eae-1b92-47a2-bc99-1203a21600c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:11.960738 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc063eae-1b92-47a2-bc99-1203a21600c8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:11.980072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 526/1041] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jul 6 20:19:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:11.983494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f12685-bec6-458a-9888-5b91836d1fa0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:11.986032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc063eae-1b92-47a2-bc99-1203a21600c8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:11.997176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:12.000207 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:12.027212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936e50f-cd07-4e2a-926a-1af303a6a319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:12.028040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e50f-cd07-4e2a-926a-1af303a6a319 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:12.028318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e50f-cd07-4e2a-926a-1af303a6a319 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:12.028589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e50f-cd07-4e2a-926a-1af303a6a319 None admin] PATH_INFO: `/v3/services/image` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:12.029290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936e50f-cd07-4e2a-926a-1af303a6a319 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:12.030666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936e50f-cd07-4e2a-926a-1af303a6a319 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a936e50f-cd07-4e2a-926a-1af303a6a319 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:12.043470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:12.044501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:12.045395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 516/1042] 10.222.0.30 () {56 vars in 1105 bytes} [Wed Jul 6 20:19:11 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:12.051326 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936e50f-cd07-4e2a-926a-1af303a6a319 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:12.111266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc063eae-1b92-47a2-bc99-1203a21600c8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:12.150390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36afed-3a46-42d1-998a-3760b447cf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:12.151099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36afed-3a46-42d1-998a-3760b447cf5b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:12.151380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36afed-3a46-42d1-998a-3760b447cf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:12.151654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36afed-3a46-42d1-998a-3760b447cf5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:12.168074 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936e50f-cd07-4e2a-926a-1af303a6a319 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:12.204282 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86bfab-70cf-4f72-9210-c39e52087a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:12.204893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86bfab-70cf-4f72-9210-c39e52087a0a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:12.205255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86bfab-70cf-4f72-9210-c39e52087a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:12.205938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86bfab-70cf-4f72-9210-c39e52087a0a None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:12.206703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86bfab-70cf-4f72-9210-c39e52087a0a None admin] RBAC: Adding query filter params (name=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:12.207281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86bfab-70cf-4f72-9210-c39e52087a0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:12.208672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86bfab-70cf-4f72-9210-c39e52087a0a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:12.214035 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 517/1043] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:12.219485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86bfab-70cf-4f72-9210-c39e52087a0a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:12.225939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36afed-3a46-42d1-998a-3760b447cf5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:12.227767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36afed-3a46-42d1-998a-3760b447cf5b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:12.238997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:12.266439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:12.326664 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86bfab-70cf-4f72-9210-c39e52087a0a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:12.338318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 527/1044] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:19:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:19:12.339205 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36afed-3a46-42d1-998a-3760b447cf5b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:12.363708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f81fd2-7e6e-4dc3-8bdf-6bac4b913ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:12.364487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f81fd2-7e6e-4dc3-8bdf-6bac4b913ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:12.364777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f81fd2-7e6e-4dc3-8bdf-6bac4b913ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:12.365069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f81fd2-7e6e-4dc3-8bdf-6bac4b913ed2 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:12.365785 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f81fd2-7e6e-4dc3-8bdf-6bac4b913ed2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:12.366087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f81fd2-7e6e-4dc3-8bdf-6bac4b913ed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:12.367701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f81fd2-7e6e-4dc3-8bdf-6bac4b913ed2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:12.374061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 518/1045] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:12.379884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f81fd2-7e6e-4dc3-8bdf-6bac4b913ed2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:12.455052 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36afed-3a46-42d1-998a-3760b447cf5b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:12.465159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:12.494537 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e81e7-499e-453c-9c79-98b3a8aa0662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:12.495509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e81e7-499e-453c-9c79-98b3a8aa0662 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:12.495884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e81e7-499e-453c-9c79-98b3a8aa0662 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:12.496242 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e81e7-499e-453c-9c79-98b3a8aa0662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:12.501407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f81fd2-7e6e-4dc3-8bdf-6bac4b913ed2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:12.504198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:12.509057 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e81e7-499e-453c-9c79-98b3a8aa0662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:12.511022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e81e7-499e-453c-9c79-98b3a8aa0662 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f91e81e7-499e-453c-9c79-98b3a8aa0662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:19:12.530739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:12.531876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:12.533390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:19:12.533390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:19:12.533390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:12.533390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:12.538357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 528/1046] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:12.539033 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e81e7-499e-453c-9c79-98b3a8aa0662 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:12.539208 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1613113-eb0e-4f0b-9867-dd89131a41d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:12.540051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1613113-eb0e-4f0b-9867-dd89131a41d4 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:12.540356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1613113-eb0e-4f0b-9867-dd89131a41d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:12.540619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1613113-eb0e-4f0b-9867-dd89131a41d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:12.541394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1613113-eb0e-4f0b-9867-dd89131a41d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:12.543534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1613113-eb0e-4f0b-9867-dd89131a41d4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:12.563362 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 519/1047] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Jul 6 20:19:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:19:12.652905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e81e7-499e-453c-9c79-98b3a8aa0662 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:12.696212 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5edaeb-118e-4268-a493-f4690c39a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:12.696892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5edaeb-118e-4268-a493-f4690c39a76e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:12.697193 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5edaeb-118e-4268-a493-f4690c39a76e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:12.697454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5edaeb-118e-4268-a493-f4690c39a76e None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:12.698198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5edaeb-118e-4268-a493-f4690c39a76e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:12.698502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5edaeb-118e-4268-a493-f4690c39a76e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:12.699894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5edaeb-118e-4268-a493-f4690c39a76e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:12.712761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 529/1048] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:12.718746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1613113-eb0e-4f0b-9867-dd89131a41d4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:12.828194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1613113-eb0e-4f0b-9867-dd89131a41d4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:12.863912 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975543c-7bd2-4976-acde-12176765e3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:12.864720 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975543c-7bd2-4976-acde-12176765e3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:12.865002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975543c-7bd2-4976-acde-12176765e3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:12.865302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975543c-7bd2-4976-acde-12176765e3f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:12.872600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975543c-7bd2-4976-acde-12176765e3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:12.874081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975543c-7bd2-4976-acde-12176765e3f0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9975543c-7bd2-4976-acde-12176765e3f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:19:12.888897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:12.889934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:12.890811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:19:12.890811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:19:12.890811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:19:12.890811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:19:12.890811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:19:12.890811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:19:12.890811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:19:12.890811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:12.890811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 520/1049] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:19:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:12.896139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5edaeb-118e-4268-a493-f4690c39a76e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:12.915547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:12.999788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5edaeb-118e-4268-a493-f4690c39a76e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:13.037745 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372ae36-7691-4b8d-8a01-10c7da5159eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:13.038427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372ae36-7691-4b8d-8a01-10c7da5159eb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:13.038706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372ae36-7691-4b8d-8a01-10c7da5159eb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:13.038977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372ae36-7691-4b8d-8a01-10c7da5159eb None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:13.039837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372ae36-7691-4b8d-8a01-10c7da5159eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:13.040148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372ae36-7691-4b8d-8a01-10c7da5159eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:13.041624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372ae36-7691-4b8d-8a01-10c7da5159eb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:13.054552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 530/1050] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:19:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:13.060531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975543c-7bd2-4976-acde-12176765e3f0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:13.084606 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:13.170439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975543c-7bd2-4976-acde-12176765e3f0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:13.205478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0eeac-0478-485a-9b39-110d3a3c346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:13.206142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0eeac-0478-485a-9b39-110d3a3c346d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:13.206425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0eeac-0478-485a-9b39-110d3a3c346d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:13.206700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0eeac-0478-485a-9b39-110d3a3c346d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:13.207620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0eeac-0478-485a-9b39-110d3a3c346d None admin] RBAC: Adding query filter params (role.id=c52265f4bfdd4b54a2401176941d60f8, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=56ad461f6dc54014a956e5c8a094352c) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:13.207940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0eeac-0478-485a-9b39-110d3a3c346d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:13.209437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0eeac-0478-485a-9b39-110d3a3c346d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:13.215269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 521/1051] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:19:13 2022] GET /identity/v3/role_assignments?user.id=56ad461f6dc54014a956e5c8a094352c&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=c52265f4bfdd4b54a2401176941d60f8 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:13.941814 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f83e1c-d7c7-435b-aeea-f7500987208b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:13.942358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f83e1c-d7c7-435b-aeea-f7500987208b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:13.942358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f83e1c-d7c7-435b-aeea-f7500987208b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:13.943720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 531/1052] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:13.949304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a28683-91cb-4ade-ae43-09a838359aa2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:13.949732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a28683-91cb-4ade-ae43-09a838359aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:13.949812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a28683-91cb-4ade-ae43-09a838359aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:13.967351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-78a28683-91cb-4ade-ae43-09a838359aa2 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:13.968529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-78a28683-91cb-4ade-ae43-09a838359aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:14.036997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 522/1053] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:14.060038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f83e1c-d7c7-435b-aeea-f7500987208b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:14.140019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:14.165689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f83e1c-d7c7-435b-aeea-f7500987208b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:14.200016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b2281-7db2-4279-87d6-bfde7117b15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:14.200835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b2281-7db2-4279-87d6-bfde7117b15e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:14.201143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b2281-7db2-4279-87d6-bfde7117b15e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:14.201422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b2281-7db2-4279-87d6-bfde7117b15e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:14.211776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b2281-7db2-4279-87d6-bfde7117b15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-221b2281-7db2-4279-87d6-bfde7117b15e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:19:14.219385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:14.220321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:14.221569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:14.225342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 532/1054] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:19:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:14.226822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a28683-91cb-4ade-ae43-09a838359aa2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:14.244160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:14.337594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a28683-91cb-4ade-ae43-09a838359aa2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:14.375460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac0c17-8604-48aa-8493-b4c5619c300d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:14.376133 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0c17-8604-48aa-8493-b4c5619c300d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:14.376377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0c17-8604-48aa-8493-b4c5619c300d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:14.376678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0c17-8604-48aa-8493-b4c5619c300d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:14.377478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac0c17-8604-48aa-8493-b4c5619c300d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:14.377782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac0c17-8604-48aa-8493-b4c5619c300d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:14.379190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac0c17-8604-48aa-8493-b4c5619c300d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:14.388276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 523/1055] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:19:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:14.393958 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b2281-7db2-4279-87d6-bfde7117b15e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:14.497484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b2281-7db2-4279-87d6-bfde7117b15e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:14.533219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e360ea-41d0-49a4-8537-4fde5978e2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:14.534105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e360ea-41d0-49a4-8537-4fde5978e2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:14.534348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e360ea-41d0-49a4-8537-4fde5978e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:14.534748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e360ea-41d0-49a4-8537-4fde5978e2a3 None admin] PATH_INFO: `/v3/users/ed3e138cb5b344e0b503d964c5b00f39` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:14.537842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:14.550905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e360ea-41d0-49a4-8537-4fde5978e2a3 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3e138cb5b344e0b503d964c5b00f39)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:14.552367 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e360ea-41d0-49a4-8537-4fde5978e2a3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:14.554376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 533/1056] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:14 2022] GET /identity/v3/users/ed3e138cb5b344e0b503d964c5b00f39 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:14.560123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac0c17-8604-48aa-8493-b4c5619c300d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:14.593272 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a126344-fcfb-4c07-a8d6-25dc64413406 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:14.593608 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a126344-fcfb-4c07-a8d6-25dc64413406 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:14.594055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a126344-fcfb-4c07-a8d6-25dc64413406 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:14.595434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 534/1057] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:14.600432 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3f9ae-a3e1-4112-928a-d7e88428faa1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:14.600712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3f9ae-a3e1-4112-928a-d7e88428faa1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:14.601014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3f9ae-a3e1-4112-928a-d7e88428faa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:14.618540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-eab3f9ae-a3e1-4112-928a-d7e88428faa1 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:14.619752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eab3f9ae-a3e1-4112-928a-d7e88428faa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:14.643316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:14.669304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac0c17-8604-48aa-8493-b4c5619c300d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:14.694757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 535/1058] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:14.709522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903daa23-6db2-44dd-91d2-943a3c65bdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:14.710189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903daa23-6db2-44dd-91d2-943a3c65bdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:14.710468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903daa23-6db2-44dd-91d2-943a3c65bdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:14.710747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903daa23-6db2-44dd-91d2-943a3c65bdb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:14.716827 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3f9ae-a3e1-4112-928a-d7e88428faa1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:14.783772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903daa23-6db2-44dd-91d2-943a3c65bdb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:14.785392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903daa23-6db2-44dd-91d2-943a3c65bdb7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:14.833872 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3f9ae-a3e1-4112-928a-d7e88428faa1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:14.858533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:14.870825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d448d41-983d-4c7a-a2d9-b43e8755ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:14.871514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d448d41-983d-4c7a-a2d9-b43e8755ba2c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:14.871799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d448d41-983d-4c7a-a2d9-b43e8755ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:14.872074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d448d41-983d-4c7a-a2d9-b43e8755ba2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:14.875850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:14.902617 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 524/1059] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:19:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:19:14.908197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903daa23-6db2-44dd-91d2-943a3c65bdb7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:14.944121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d448d41-983d-4c7a-a2d9-b43e8755ba2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:14.945556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d448d41-983d-4c7a-a2d9-b43e8755ba2c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:15.015079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903daa23-6db2-44dd-91d2-943a3c65bdb7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:15.050347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6a06d-43d2-45e9-9243-6791547e033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:15.051261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6a06d-43d2-45e9-9243-6791547e033e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:15.051546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6a06d-43d2-45e9-9243-6791547e033e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:15.051795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6a06d-43d2-45e9-9243-6791547e033e None admin] PATH_INFO: `/v3/projects/6471e5bd425640a793ea5d0f0abaa013` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:15.053080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6a06d-43d2-45e9-9243-6791547e033e None admin] RBAC: Authorizing `identity:get_project(project_id=6471e5bd425640a793ea5d0f0abaa013)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:15.054524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6a06d-43d2-45e9-9243-6791547e033e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:15.056442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 525/1060] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:19:14 2022] GET /identity/v3/projects/6471e5bd425640a793ea5d0f0abaa013 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:15.064080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 536/1061] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:19:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:19:15.064264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6a06d-43d2-45e9-9243-6791547e033e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:15.065778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d448d41-983d-4c7a-a2d9-b43e8755ba2c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:15.091280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:15.112584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:15.172765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6a06d-43d2-45e9-9243-6791547e033e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:15.179904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d448d41-983d-4c7a-a2d9-b43e8755ba2c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:15.213858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0db45-9716-485d-a502-3d0bd6ca7fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:15.214517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0db45-9716-485d-a502-3d0bd6ca7fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:15.214792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0db45-9716-485d-a502-3d0bd6ca7fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:15.215073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0db45-9716-485d-a502-3d0bd6ca7fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:15.215916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0db45-9716-485d-a502-3d0bd6ca7fb3 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=6471e5bd425640a793ea5d0f0abaa013, user.id=ed3e138cb5b344e0b503d964c5b00f39) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:15.216209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0db45-9716-485d-a502-3d0bd6ca7fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:15.217679 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0db45-9716-485d-a502-3d0bd6ca7fb3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:15.218748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8922e-527e-4187-8b3b-13f41483bdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:15.219584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8922e-527e-4187-8b3b-13f41483bdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:15.219846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8922e-527e-4187-8b3b-13f41483bdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:15.220118 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8922e-527e-4187-8b3b-13f41483bdd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:15.223392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 526/1062] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:19:15 2022] GET /identity/v3/role_assignments?user.id=ed3e138cb5b344e0b503d964c5b00f39&scope.project.id=6471e5bd425640a793ea5d0f0abaa013&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:15.224591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd4768-8cbd-4c77-9a65-846e2f752e52 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:15.224874 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd4768-8cbd-4c77-9a65-846e2f752e52 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:15.225179 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd4768-8cbd-4c77-9a65-846e2f752e52 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:15.226620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 527/1063] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:15.231222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8922e-527e-4187-8b3b-13f41483bdd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:15.232425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8e8f6-34ce-4c9d-a1e7-1682248fb956 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:15.232713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8e8f6-34ce-4c9d-a1e7-1682248fb956 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:15.232841 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8922e-527e-4187-8b3b-13f41483bdd7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:15.233052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8e8f6-34ce-4c9d-a1e7-1682248fb956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8ca8922e-527e-4187-8b3b-13f41483bdd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:19:15.252657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:15.253800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:15.255029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:19:15.255029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:19:15.255029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:15.255029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:15.255029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 537/1064] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:19:15.256234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-22d8e8f6-34ce-4c9d-a1e7-1682248fb956 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:15.257519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-22d8e8f6-34ce-4c9d-a1e7-1682248fb956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:15.260853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8922e-527e-4187-8b3b-13f41483bdd7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:15.334102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 528/1065] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:19:15.348428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:15.357550 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8e8f6-34ce-4c9d-a1e7-1682248fb956 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:15.375860 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8922e-527e-4187-8b3b-13f41483bdd7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:15.401545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:15.420416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa7c51-c210-45aa-9d0a-1fb2140689f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:15.421126 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa7c51-c210-45aa-9d0a-1fb2140689f0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:15.421422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa7c51-c210-45aa-9d0a-1fb2140689f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:15.421670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa7c51-c210-45aa-9d0a-1fb2140689f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:15.422421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa7c51-c210-45aa-9d0a-1fb2140689f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:15.422729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa7c51-c210-45aa-9d0a-1fb2140689f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:15.424114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa7c51-c210-45aa-9d0a-1fb2140689f0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:15.437417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 538/1066] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:15.468148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8e8f6-34ce-4c9d-a1e7-1682248fb956 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:15.508900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe940005-7471-4b43-b25c-c36e535c4198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:15.509840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940005-7471-4b43-b25c-c36e535c4198 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:15.510119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940005-7471-4b43-b25c-c36e535c4198 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:15.510392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940005-7471-4b43-b25c-c36e535c4198 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:15.522788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe940005-7471-4b43-b25c-c36e535c4198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fe940005-7471-4b43-b25c-c36e535c4198 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:19:15.531271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:15.532279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:15.533891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 529/1067] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jul 6 20:19:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:19:15.539198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa7c51-c210-45aa-9d0a-1fb2140689f0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:15.649192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa7c51-c210-45aa-9d0a-1fb2140689f0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:15.685130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee6d2d-1c52-488a-91ea-99da59bb02f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:15.685830 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee6d2d-1c52-488a-91ea-99da59bb02f1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:15.686112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee6d2d-1c52-488a-91ea-99da59bb02f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:15.686433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee6d2d-1c52-488a-91ea-99da59bb02f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:15.687207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee6d2d-1c52-488a-91ea-99da59bb02f1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:15.687522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee6d2d-1c52-488a-91ea-99da59bb02f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:15.688922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee6d2d-1c52-488a-91ea-99da59bb02f1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:15.694630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:15.699280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 539/1068] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Jul 6 20:19:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:15.706607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe940005-7471-4b43-b25c-c36e535c4198 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:15.806122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:15.811101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe940005-7471-4b43-b25c-c36e535c4198 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:15.847584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ceee-adcc-4a79-9eb8-85b3958a9fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:15.848382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ceee-adcc-4a79-9eb8-85b3958a9fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:15.848658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ceee-adcc-4a79-9eb8-85b3958a9fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:15.848921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ceee-adcc-4a79-9eb8-85b3958a9fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:15.860033 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1ceee-adcc-4a79-9eb8-85b3958a9fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:15.861509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1ceee-adcc-4a79-9eb8-85b3958a9fd7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-30e1ceee-adcc-4a79-9eb8-85b3958a9fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:19:15.878443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:15.879355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:15.880842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:19:15.880842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:19:15.880842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:15.880842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:15.880842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 530/1069] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:19:15.885999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee6d2d-1c52-488a-91ea-99da59bb02f1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:15.982879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee6d2d-1c52-488a-91ea-99da59bb02f1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:16.017746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45b40c-c762-4da6-9d2e-42bcdac5c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:16.018409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45b40c-c762-4da6-9d2e-42bcdac5c3cb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:16.018687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45b40c-c762-4da6-9d2e-42bcdac5c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:16.018954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45b40c-c762-4da6-9d2e-42bcdac5c3cb None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:16.019763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45b40c-c762-4da6-9d2e-42bcdac5c3cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:16.020064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45b40c-c762-4da6-9d2e-42bcdac5c3cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:16.021466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45b40c-c762-4da6-9d2e-42bcdac5c3cb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:16.032838 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 540/1070] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:16.038908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ceee-adcc-4a79-9eb8-85b3958a9fd7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:16.139563 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ceee-adcc-4a79-9eb8-85b3958a9fd7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:16.172975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af081466-30a4-4285-80c3-c360f8419c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:16.173778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af081466-30a4-4285-80c3-c360f8419c94 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:16.174022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af081466-30a4-4285-80c3-c360f8419c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:16.174314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af081466-30a4-4285-80c3-c360f8419c94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:16.181897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af081466-30a4-4285-80c3-c360f8419c94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:16.183328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af081466-30a4-4285-80c3-c360f8419c94 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-af081466-30a4-4285-80c3-c360f8419c94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:19:16.196992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:16.198073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:16.199595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:16.199595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:16.199595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:19:16.199595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:19:16.199595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:19:16.199595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:19:16.199595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:19:16.199595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:19:16.199595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:19:16.199595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:16.199595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 531/1071] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Jul 6 20:19:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:16.204160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45b40c-c762-4da6-9d2e-42bcdac5c3cb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:16.266252 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:16.309745 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45b40c-c762-4da6-9d2e-42bcdac5c3cb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:16.346840 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072ed6d-d2d2-4f02-aeb1-5b990497bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:16.347736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072ed6d-d2d2-4f02-aeb1-5b990497bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:16.348012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072ed6d-d2d2-4f02-aeb1-5b990497bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:16.348325 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072ed6d-d2d2-4f02-aeb1-5b990497bcd6 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:16.349229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072ed6d-d2d2-4f02-aeb1-5b990497bcd6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:16.349535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072ed6d-d2d2-4f02-aeb1-5b990497bcd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:16.350956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072ed6d-d2d2-4f02-aeb1-5b990497bcd6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:16.368401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 541/1072] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jul 6 20:19:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:16.374013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af081466-30a4-4285-80c3-c360f8419c94 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:16.388054 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:16.477622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af081466-30a4-4285-80c3-c360f8419c94 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:16.511618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2f642-82d9-4eeb-aa26-cbdea38b574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:16.512408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f642-82d9-4eeb-aa26-cbdea38b574f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:16.512690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f642-82d9-4eeb-aa26-cbdea38b574f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:16.512980 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f642-82d9-4eeb-aa26-cbdea38b574f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:16.524163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2f642-82d9-4eeb-aa26-cbdea38b574f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:16.525635 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2f642-82d9-4eeb-aa26-cbdea38b574f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6ff2f642-82d9-4eeb-aa26-cbdea38b574f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:19:16.542546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:16.543456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:16.544354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:19:16.544354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:19:16.544354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:16.544354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:16.544354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 532/1073] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:16.549559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072ed6d-d2d2-4f02-aeb1-5b990497bcd6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:16.649024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072ed6d-d2d2-4f02-aeb1-5b990497bcd6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:16.665533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:16.685454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a557-c998-4670-8d1e-05a67eedbdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:16.686143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a557-c998-4670-8d1e-05a67eedbdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:16.686421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a557-c998-4670-8d1e-05a67eedbdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:16.686690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a557-c998-4670-8d1e-05a67eedbdd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:16.687452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47a557-c998-4670-8d1e-05a67eedbdd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:16.687764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47a557-c998-4670-8d1e-05a67eedbdd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:16.689165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47a557-c998-4670-8d1e-05a67eedbdd2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:16.700882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 542/1074] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:16.706902 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2f642-82d9-4eeb-aa26-cbdea38b574f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:16.772176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:16.811570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2f642-82d9-4eeb-aa26-cbdea38b574f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:16.846050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ed078-ad5c-4545-b6dc-f8b94c373067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:16.846850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ed078-ad5c-4545-b6dc-f8b94c373067 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:16.847130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ed078-ad5c-4545-b6dc-f8b94c373067 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:16.847425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ed078-ad5c-4545-b6dc-f8b94c373067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:16.854489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ed078-ad5c-4545-b6dc-f8b94c373067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:16.855919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ed078-ad5c-4545-b6dc-f8b94c373067 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6a3ed078-ad5c-4545-b6dc-f8b94c373067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:19:16.870657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:16.871596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:16.872478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:19:16.872478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:19:16.872478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:19:16.872478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:19:16.872478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:19:16.872478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:19:16.872478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:19:16.872478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:16.872478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 533/1075] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:19:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:16.877896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a557-c998-4670-8d1e-05a67eedbdd2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:16.979676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a557-c998-4670-8d1e-05a67eedbdd2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:17.014188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ad9b5-592e-4910-8034-891621b865b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:17.014809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad9b5-592e-4910-8034-891621b865b5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:17.015096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad9b5-592e-4910-8034-891621b865b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:17.015435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad9b5-592e-4910-8034-891621b865b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:17.016223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ad9b5-592e-4910-8034-891621b865b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:17.016527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ad9b5-592e-4910-8034-891621b865b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:17.017994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ad9b5-592e-4910-8034-891621b865b5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:17.030153 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 543/1076] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:19:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:17.036365 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ed078-ad5c-4545-b6dc-f8b94c373067 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:17.137356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ed078-ad5c-4545-b6dc-f8b94c373067 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:17.161875 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:17.173509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bd359-67eb-4c61-b13f-c63e5d8964fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:17.174401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd359-67eb-4c61-b13f-c63e5d8964fb None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:17.174674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd359-67eb-4c61-b13f-c63e5d8964fb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:17.174942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd359-67eb-4c61-b13f-c63e5d8964fb None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/56ad461f6dc54014a956e5c8a094352c/roles/c52265f4bfdd4b54a2401176941d60f8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:17.177152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bd359-67eb-4c61-b13f-c63e5d8964fb None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=56ad461f6dc54014a956e5c8a094352c, role_id=c52265f4bfdd4b54a2401176941d60f8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:17.178577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bd359-67eb-4c61-b13f-c63e5d8964fb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:17.194325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 534/1077] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:19:17 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/56ad461f6dc54014a956e5c8a094352c/roles/c52265f4bfdd4b54a2401176941d60f8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:19:17.237433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bd330-302b-435b-a4b5-9fb21e9a4aae None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:17.237691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bd330-302b-435b-a4b5-9fb21e9a4aae None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:17.238033 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bd330-302b-435b-a4b5-9fb21e9a4aae None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:17.239439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 544/1078] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:17.245595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416e62-5727-49b6-95b9-e72eff71355d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:17.245888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416e62-5727-49b6-95b9-e72eff71355d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:17.246160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416e62-5727-49b6-95b9-e72eff71355d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:17.265450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-47416e62-5727-49b6-95b9-e72eff71355d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:17.267285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-47416e62-5727-49b6-95b9-e72eff71355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:17.346279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 535/1079] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:17.369152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bd330-302b-435b-a4b5-9fb21e9a4aae None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:17.406419 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:17.472069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bd330-302b-435b-a4b5-9fb21e9a4aae None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:17.509326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2399-de14-4d56-8aef-22f97e1f1fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:17.510147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2399-de14-4d56-8aef-22f97e1f1fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:17.510407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2399-de14-4d56-8aef-22f97e1f1fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:17.510681 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2399-de14-4d56-8aef-22f97e1f1fb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:17.524760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f2399-de14-4d56-8aef-22f97e1f1fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3e0f2399-de14-4d56-8aef-22f97e1f1fb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:19:17.533533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:17.534562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:17.540806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 545/1080] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:19:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:17.541663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47416e62-5727-49b6-95b9-e72eff71355d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:17.646309 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47416e62-5727-49b6-95b9-e72eff71355d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:17.659508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:17.682380 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb62874-c8f9-47e5-8c77-0ac1ef1c77f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:17.683049 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb62874-c8f9-47e5-8c77-0ac1ef1c77f2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:17.683323 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb62874-c8f9-47e5-8c77-0ac1ef1c77f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:17.683592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb62874-c8f9-47e5-8c77-0ac1ef1c77f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:17.684355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb62874-c8f9-47e5-8c77-0ac1ef1c77f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:17.684656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb62874-c8f9-47e5-8c77-0ac1ef1c77f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:17.686106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb62874-c8f9-47e5-8c77-0ac1ef1c77f2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:17.694468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 536/1081] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:19:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:17.700579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2399-de14-4d56-8aef-22f97e1f1fb6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:17.793737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:17.800443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2399-de14-4d56-8aef-22f97e1f1fb6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:17.840563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d6da7-0707-4d09-b58c-b90c2417ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:17.841472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d6da7-0707-4d09-b58c-b90c2417ef8d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:17.841748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d6da7-0707-4d09-b58c-b90c2417ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:17.842020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d6da7-0707-4d09-b58c-b90c2417ef8d None admin] PATH_INFO: `/v3/users/ed3e138cb5b344e0b503d964c5b00f39` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:17.843221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d6da7-0707-4d09-b58c-b90c2417ef8d None admin] RBAC: Authorizing `identity:get_user(user_id=ed3e138cb5b344e0b503d964c5b00f39)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:17.844641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d6da7-0707-4d09-b58c-b90c2417ef8d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:17.846311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 546/1082] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:17 2022] GET /identity/v3/users/ed3e138cb5b344e0b503d964c5b00f39 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:17.852355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb62874-c8f9-47e5-8c77-0ac1ef1c77f2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:17.956765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb62874-c8f9-47e5-8c77-0ac1ef1c77f2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:17.990937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008414e-6e19-4b07-96c0-aca8d0bc5766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:17.991808 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008414e-6e19-4b07-96c0-aca8d0bc5766 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:17.992087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008414e-6e19-4b07-96c0-aca8d0bc5766 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:17.992356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008414e-6e19-4b07-96c0-aca8d0bc5766 None admin] PATH_INFO: `/v3/projects/6471e5bd425640a793ea5d0f0abaa013` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:17.993599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008414e-6e19-4b07-96c0-aca8d0bc5766 None admin] RBAC: Authorizing `identity:get_project(project_id=6471e5bd425640a793ea5d0f0abaa013)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:17.995038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008414e-6e19-4b07-96c0-aca8d0bc5766 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:17.996754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 537/1083] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:19:17 2022] GET /identity/v3/projects/6471e5bd425640a793ea5d0f0abaa013 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:18.003123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d6da7-0707-4d09-b58c-b90c2417ef8d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:18.106968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d6da7-0707-4d09-b58c-b90c2417ef8d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:18.141049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63b2eb-e7d0-4870-a705-8080605332ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:18.141963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b2eb-e7d0-4870-a705-8080605332ab None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:18.142243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b2eb-e7d0-4870-a705-8080605332ab None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:18.142507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b2eb-e7d0-4870-a705-8080605332ab None admin] PATH_INFO: `/v3/projects/6471e5bd425640a793ea5d0f0abaa013/users/ed3e138cb5b344e0b503d964c5b00f39/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:18.144600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63b2eb-e7d0-4870-a705-8080605332ab None admin] RBAC: Authorizing `identity:create_grant(project_id=6471e5bd425640a793ea5d0f0abaa013, user_id=ed3e138cb5b344e0b503d964c5b00f39, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:18.146052 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63b2eb-e7d0-4870-a705-8080605332ab None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:18.161682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 547/1084] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:19:18 2022] PUT /identity/v3/projects/6471e5bd425640a793ea5d0f0abaa013/users/ed3e138cb5b344e0b503d964c5b00f39/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:19:19.194866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddcfa2-1ab3-49f3-9718-7c21a6c4170e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:19.195400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddcfa2-1ab3-49f3-9718-7c21a6c4170e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:19.195400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddcfa2-1ab3-49f3-9718-7c21a6c4170e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:19.196692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 538/1085] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:19.201940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ca05c-3637-4255-a505-3c9aa02faa82 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:19.202407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ca05c-3637-4255-a505-3c9aa02faa82 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:19.202517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ca05c-3637-4255-a505-3c9aa02faa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:19.220150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9e1ca05c-3637-4255-a505-3c9aa02faa82 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:19.221415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9e1ca05c-3637-4255-a505-3c9aa02faa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:19.241902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:19.293268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 548/1086] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:19.317309 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddcfa2-1ab3-49f3-9718-7c21a6c4170e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:19.363437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:19.423851 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddcfa2-1ab3-49f3-9718-7c21a6c4170e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:19.458487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7904fa-ffd1-4119-b338-c5d19a81ac5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:19.459234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7904fa-ffd1-4119-b338-c5d19a81ac5e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:19.459519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7904fa-ffd1-4119-b338-c5d19a81ac5e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:19.459794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7904fa-ffd1-4119-b338-c5d19a81ac5e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:19.470395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7904fa-ffd1-4119-b338-c5d19a81ac5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3c7904fa-ffd1-4119-b338-c5d19a81ac5e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:19:19.478657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:19.479612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:19.480692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 539/1087] 10.222.0.30 () {56 vars in 1120 bytes} [Wed Jul 6 20:19:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:19.485969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ca05c-3637-4255-a505-3c9aa02faa82 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:19.587148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ca05c-3637-4255-a505-3c9aa02faa82 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:19.622826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d30c4-16d0-4847-be62-a02b238674f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:19.623492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d30c4-16d0-4847-be62-a02b238674f3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:19.623770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d30c4-16d0-4847-be62-a02b238674f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:19.624045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d30c4-16d0-4847-be62-a02b238674f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:19.624797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d30c4-16d0-4847-be62-a02b238674f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:19.625140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d30c4-16d0-4847-be62-a02b238674f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:19.626516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d30c4-16d0-4847-be62-a02b238674f3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:19.635329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 549/1088] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Jul 6 20:19:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:19.640940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7904fa-ffd1-4119-b338-c5d19a81ac5e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:19.743846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7904fa-ffd1-4119-b338-c5d19a81ac5e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:19.745471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:19.780492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07976e47-4875-45da-a493-bf54f5f0cb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:19.781391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07976e47-4875-45da-a493-bf54f5f0cb60 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:19.781672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07976e47-4875-45da-a493-bf54f5f0cb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:19.781942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07976e47-4875-45da-a493-bf54f5f0cb60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:19.793164 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07976e47-4875-45da-a493-bf54f5f0cb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:19.794617 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07976e47-4875-45da-a493-bf54f5f0cb60 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-07976e47-4875-45da-a493-bf54f5f0cb60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:19:19.812491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:19.813557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:19.814511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:19:19.814511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:19:19.814511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:19.814511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:19.814511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 540/1089] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:19.819594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d30c4-16d0-4847-be62-a02b238674f3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:19.841266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:19.925438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d30c4-16d0-4847-be62-a02b238674f3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:19.960019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7708e-2bc2-43f8-b448-896c3c81141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:19.960681 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7708e-2bc2-43f8-b448-896c3c81141b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:19.960980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7708e-2bc2-43f8-b448-896c3c81141b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:19.961267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7708e-2bc2-43f8-b448-896c3c81141b None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:19.961993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7708e-2bc2-43f8-b448-896c3c81141b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:19.962298 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7708e-2bc2-43f8-b448-896c3c81141b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:19.963662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7708e-2bc2-43f8-b448-896c3c81141b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:19.975987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 550/1090] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:19.981940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07976e47-4875-45da-a493-bf54f5f0cb60 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:20.085982 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07976e47-4875-45da-a493-bf54f5f0cb60 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:20.120495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664840f5-e87c-4815-9dd4-354ed2f6b235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:20.121327 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664840f5-e87c-4815-9dd4-354ed2f6b235 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:20.121605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664840f5-e87c-4815-9dd4-354ed2f6b235 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:20.121880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664840f5-e87c-4815-9dd4-354ed2f6b235 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:20.127270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049c0c-2e9a-4173-9afb-d477e31e6587 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:20.127549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049c0c-2e9a-4173-9afb-d477e31e6587 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:20.127817 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049c0c-2e9a-4173-9afb-d477e31e6587 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:20.129287 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 551/1091] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:19:20.129676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664840f5-e87c-4815-9dd4-354ed2f6b235 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:20.131482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664840f5-e87c-4815-9dd4-354ed2f6b235 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:20.134382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2b18-c91a-47d1-a839-c570deb5e2ee None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:20.134661 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2b18-c91a-47d1-a839-c570deb5e2ee None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:20.134929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2b18-c91a-47d1-a839-c570deb5e2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-664840f5-e87c-4815-9dd4-354ed2f6b235 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:19:20.147221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:20.148194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:20.149161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:20.149161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:20.149161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:19:20.149161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:19:20.149161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:19:20.149161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:19:20.149161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:19:20.149161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:19:20.149161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:19:20.149161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:20.149161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 541/1092] 10.222.0.30 () {56 vars in 1093 bytes} [Wed Jul 6 20:19:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:20.151202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-436a2b18-c91a-47d1-a839-c570deb5e2ee None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:20.152362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-436a2b18-c91a-47d1-a839-c570deb5e2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:20.154082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664840f5-e87c-4815-9dd4-354ed2f6b235 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:20.169915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:20.220015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 552/1093] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:19:20.243366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a2b18-c91a-47d1-a839-c570deb5e2ee None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:20.251162 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:20.254263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664840f5-e87c-4815-9dd4-354ed2f6b235 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:20.290088 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f0ed5-eda7-4c64-927e-5ae99a629538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:20.291068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f0ed5-eda7-4c64-927e-5ae99a629538 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:20.291509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f0ed5-eda7-4c64-927e-5ae99a629538 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:20.291778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f0ed5-eda7-4c64-927e-5ae99a629538 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:20.292619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f0ed5-eda7-4c64-927e-5ae99a629538 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:20.292919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f0ed5-eda7-4c64-927e-5ae99a629538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:20.294475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f0ed5-eda7-4c64-927e-5ae99a629538 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:20.312041 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 542/1094] 10.222.0.30 () {56 vars in 1133 bytes} [Wed Jul 6 20:19:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:20.317746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f0ed5-eda7-4c64-927e-5ae99a629538 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:20.348660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a2b18-c91a-47d1-a839-c570deb5e2ee None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:20.383593 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989910a-4a06-43f5-9755-3f0e4e26704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:20.384389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989910a-4a06-43f5-9755-3f0e4e26704e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:20.384662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989910a-4a06-43f5-9755-3f0e4e26704e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:20.384940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989910a-4a06-43f5-9755-3f0e4e26704e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:20.388506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:20.395415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989910a-4a06-43f5-9755-3f0e4e26704e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8989910a-4a06-43f5-9755-3f0e4e26704e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:19:20.402907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:20.404045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:20.405082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 553/1095] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:20.410183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989910a-4a06-43f5-9755-3f0e4e26704e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:20.417857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f0ed5-eda7-4c64-927e-5ae99a629538 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:20.453567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465536df-8a92-4125-b564-adfa50e478d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:20.454220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465536df-8a92-4125-b564-adfa50e478d2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:20.454500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465536df-8a92-4125-b564-adfa50e478d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:20.454779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465536df-8a92-4125-b564-adfa50e478d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:20.478178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:20.513572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989910a-4a06-43f5-9755-3f0e4e26704e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:20.523047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465536df-8a92-4125-b564-adfa50e478d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:20.524842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465536df-8a92-4125-b564-adfa50e478d2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:20.546033 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52749d7-2da6-40e1-8f87-21420f192555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:20.546705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52749d7-2da6-40e1-8f87-21420f192555 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:20.546984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52749d7-2da6-40e1-8f87-21420f192555 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:20.547258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52749d7-2da6-40e1-8f87-21420f192555 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:20.548014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52749d7-2da6-40e1-8f87-21420f192555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:20.548320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52749d7-2da6-40e1-8f87-21420f192555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:20.549767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52749d7-2da6-40e1-8f87-21420f192555 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:20.557766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 554/1096] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:19:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:20.563647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52749d7-2da6-40e1-8f87-21420f192555 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:20.591212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:20.621693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 543/1097] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:19:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:19:20.627332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465536df-8a92-4125-b564-adfa50e478d2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:20.662910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52749d7-2da6-40e1-8f87-21420f192555 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:20.688378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:20.697234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cbea9-8bce-4453-8462-6a0892bc32f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:20.698099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cbea9-8bce-4453-8462-6a0892bc32f8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:20.698373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cbea9-8bce-4453-8462-6a0892bc32f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:20.698639 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cbea9-8bce-4453-8462-6a0892bc32f8 None admin] PATH_INFO: `/v3/users/ed3e138cb5b344e0b503d964c5b00f39` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:20.699820 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cbea9-8bce-4453-8462-6a0892bc32f8 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3e138cb5b344e0b503d964c5b00f39)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:20.701263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cbea9-8bce-4453-8462-6a0892bc32f8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:20.703032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 555/1098] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:20 2022] GET /identity/v3/users/ed3e138cb5b344e0b503d964c5b00f39 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:20.708585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cbea9-8bce-4453-8462-6a0892bc32f8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:20.724753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465536df-8a92-4125-b564-adfa50e478d2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:20.759245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97332912-0b21-4ac1-8c2b-41b6031e3a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:20.760038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97332912-0b21-4ac1-8c2b-41b6031e3a75 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:20.760311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97332912-0b21-4ac1-8c2b-41b6031e3a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:20.760579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97332912-0b21-4ac1-8c2b-41b6031e3a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:20.770408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97332912-0b21-4ac1-8c2b-41b6031e3a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:20.771856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97332912-0b21-4ac1-8c2b-41b6031e3a75 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-97332912-0b21-4ac1-8c2b-41b6031e3a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:19:20.789153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:20.791143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:20.793126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:19:20.793126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:19:20.793126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:19:20.793126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:20.793126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 544/1099] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:19:20.795922 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97332912-0b21-4ac1-8c2b-41b6031e3a75 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:20.816600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cbea9-8bce-4453-8462-6a0892bc32f8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:20.824328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:20.852700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b034f-4798-441b-88d3-914f5b965a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:20.853401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b034f-4798-441b-88d3-914f5b965a75 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:20.853717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b034f-4798-441b-88d3-914f5b965a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:20.853988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b034f-4798-441b-88d3-914f5b965a75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:20.899256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97332912-0b21-4ac1-8c2b-41b6031e3a75 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:20.917226 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:20.924832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b034f-4798-441b-88d3-914f5b965a75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:20.926393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b034f-4798-441b-88d3-914f5b965a75 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:20.933841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbda3a-b2fa-4e84-a5f5-c11f30531174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:20.934510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbda3a-b2fa-4e84-a5f5-c11f30531174 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:20.934786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbda3a-b2fa-4e84-a5f5-c11f30531174 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:20.935050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbda3a-b2fa-4e84-a5f5-c11f30531174 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:20.935772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbda3a-b2fa-4e84-a5f5-c11f30531174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:20.936078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbda3a-b2fa-4e84-a5f5-c11f30531174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:20.937466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbda3a-b2fa-4e84-a5f5-c11f30531174 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:20.949244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 545/1100] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:20.954778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbda3a-b2fa-4e84-a5f5-c11f30531174 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:21.023714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 556/1101] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:19:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:19:21.029439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b034f-4798-441b-88d3-914f5b965a75 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:21.037251 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:21.055664 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbda3a-b2fa-4e84-a5f5-c11f30531174 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:21.090465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6f620-b466-459f-a13f-45f4c43b6f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:21.091259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6f620-b466-459f-a13f-45f4c43b6f0d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:21.091540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6f620-b466-459f-a13f-45f4c43b6f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:21.091813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6f620-b466-459f-a13f-45f4c43b6f0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:21.098572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6f620-b466-459f-a13f-45f4c43b6f0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:21.100011 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6f620-b466-459f-a13f-45f4c43b6f0d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-60d6f620-b466-459f-a13f-45f4c43b6f0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:19:21.115197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:21.116086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:21.117010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:19:21.117010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:19:21.117010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:19:21.117010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:19:21.117010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:19:21.117010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:19:21.117010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:19:21.117010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:21.117010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 546/1102] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:19:21.120118 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:21.122471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6f620-b466-459f-a13f-45f4c43b6f0d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:21.126636 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b034f-4798-441b-88d3-914f5b965a75 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:21.159437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443efa85-e6a5-461f-8fcf-8bf6483ec658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:21.160244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443efa85-e6a5-461f-8fcf-8bf6483ec658 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:21.160520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443efa85-e6a5-461f-8fcf-8bf6483ec658 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:21.160789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443efa85-e6a5-461f-8fcf-8bf6483ec658 None admin] PATH_INFO: `/v3/projects/6471e5bd425640a793ea5d0f0abaa013` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:21.161982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443efa85-e6a5-461f-8fcf-8bf6483ec658 None admin] RBAC: Authorizing `identity:get_project(project_id=6471e5bd425640a793ea5d0f0abaa013)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:21.163396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443efa85-e6a5-461f-8fcf-8bf6483ec658 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:21.165120 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 557/1103] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:19:21 2022] GET /identity/v3/projects/6471e5bd425640a793ea5d0f0abaa013 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:21.171027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443efa85-e6a5-461f-8fcf-8bf6483ec658 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:21.222536 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6f620-b466-459f-a13f-45f4c43b6f0d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:21.257884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b92c7-a5c8-40ef-a12d-46bd9e9639db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:21.258552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b92c7-a5c8-40ef-a12d-46bd9e9639db None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:21.258838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b92c7-a5c8-40ef-a12d-46bd9e9639db None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:21.259143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b92c7-a5c8-40ef-a12d-46bd9e9639db None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:21.259931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b92c7-a5c8-40ef-a12d-46bd9e9639db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:21.260240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b92c7-a5c8-40ef-a12d-46bd9e9639db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:21.261710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b92c7-a5c8-40ef-a12d-46bd9e9639db None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:21.270801 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443efa85-e6a5-461f-8fcf-8bf6483ec658 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:21.273612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 547/1104] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:19:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:21.279532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b92c7-a5c8-40ef-a12d-46bd9e9639db None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:21.282947 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:21.305613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee375e-1a92-4a49-a129-a9e03e5d7976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:21.306264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee375e-1a92-4a49-a129-a9e03e5d7976 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:21.306540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee375e-1a92-4a49-a129-a9e03e5d7976 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:21.306809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee375e-1a92-4a49-a129-a9e03e5d7976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:21.307625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee375e-1a92-4a49-a129-a9e03e5d7976 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=6471e5bd425640a793ea5d0f0abaa013, user.id=ed3e138cb5b344e0b503d964c5b00f39) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:21.307932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee375e-1a92-4a49-a129-a9e03e5d7976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:21.309378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee375e-1a92-4a49-a129-a9e03e5d7976 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:21.315064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 558/1105] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:19:21 2022] GET /identity/v3/role_assignments?user.id=ed3e138cb5b344e0b503d964c5b00f39&scope.project.id=6471e5bd425640a793ea5d0f0abaa013&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:21.386979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b92c7-a5c8-40ef-a12d-46bd9e9639db None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:21.424254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994fbdd-7581-4bf0-bd8f-3b52d8242b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:21.424833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994fbdd-7581-4bf0-bd8f-3b52d8242b9b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:21.425219 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994fbdd-7581-4bf0-bd8f-3b52d8242b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:21.425494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994fbdd-7581-4bf0-bd8f-3b52d8242b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:21.426345 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994fbdd-7581-4bf0-bd8f-3b52d8242b9b None admin] RBAC: Adding query filter params (role.id=c52265f4bfdd4b54a2401176941d60f8, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=56ad461f6dc54014a956e5c8a094352c) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:21.426657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994fbdd-7581-4bf0-bd8f-3b52d8242b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:21.428111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994fbdd-7581-4bf0-bd8f-3b52d8242b9b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:21.434994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 548/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:19:21 2022] GET /identity/v3/role_assignments?user.id=56ad461f6dc54014a956e5c8a094352c&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=c52265f4bfdd4b54a2401176941d60f8 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:19:23.335789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6589b76-33de-4342-8252-e32d0fc6a4c1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:23.336354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6589b76-33de-4342-8252-e32d0fc6a4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:23.336354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6589b76-33de-4342-8252-e32d0fc6a4c1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:23.337762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 559/1107] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:23.344062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bf241-43b6-45a3-87e2-69ee1c90a33a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:23.344785 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bf241-43b6-45a3-87e2-69ee1c90a33a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:23.344927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bf241-43b6-45a3-87e2-69ee1c90a33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:23.365179 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b35bf241-43b6-45a3-87e2-69ee1c90a33a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:23.366391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b35bf241-43b6-45a3-87e2-69ee1c90a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:23.446358 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:23.452718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 549/1108] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:23.476745 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6589b76-33de-4342-8252-e32d0fc6a4c1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:23.509121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:23.584656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6589b76-33de-4342-8252-e32d0fc6a4c1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:23.619192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11924655-dae6-46f5-be1e-62d7a4b36036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:23.619907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924655-dae6-46f5-be1e-62d7a4b36036 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:23.620182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924655-dae6-46f5-be1e-62d7a4b36036 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:23.620444 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924655-dae6-46f5-be1e-62d7a4b36036 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:23.621678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11924655-dae6-46f5-be1e-62d7a4b36036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:23.623106 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11924655-dae6-46f5-be1e-62d7a4b36036 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:23.624734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 560/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:23.631154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bf241-43b6-45a3-87e2-69ee1c90a33a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:23.734215 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bf241-43b6-45a3-87e2-69ee1c90a33a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:23.769754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf24bb-f6eb-4829-b324-675b4ae01b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:23.770414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf24bb-f6eb-4829-b324-675b4ae01b45 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:23.770696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf24bb-f6eb-4829-b324-675b4ae01b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:23.770966 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf24bb-f6eb-4829-b324-675b4ae01b45 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:23.771675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf24bb-f6eb-4829-b324-675b4ae01b45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:23.773149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf24bb-f6eb-4829-b324-675b4ae01b45 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:23.795369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 550/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:19:23 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:19:25.817777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3e7b7-826f-4660-88a5-da96ab3e1cc4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:25.818335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3e7b7-826f-4660-88a5-da96ab3e1cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:25.818335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3e7b7-826f-4660-88a5-da96ab3e1cc4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:25.819702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 561/1111] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:25.825970 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987106a-9eb0-40d7-b5d9-ff4becb44cea None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:25.826680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987106a-9eb0-40d7-b5d9-ff4becb44cea None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:25.826968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987106a-9eb0-40d7-b5d9-ff4becb44cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:25.846531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9987106a-9eb0-40d7-b5d9-ff4becb44cea None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:25.847728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9987106a-9eb0-40d7-b5d9-ff4becb44cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:25.904469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:25.926216 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 551/1112] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:25.949709 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3e7b7-826f-4660-88a5-da96ab3e1cc4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:26.053382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:26.065413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3e7b7-826f-4660-88a5-da96ab3e1cc4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:26.103364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f23411-7718-4ecf-be6d-214394e01fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:26.104160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f23411-7718-4ecf-be6d-214394e01fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:26.104439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f23411-7718-4ecf-be6d-214394e01fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:26.104710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f23411-7718-4ecf-be6d-214394e01fe5 None admin] PATH_INFO: `/v3/roles/ce1cbac653a64c268855a459ce0aae34` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:26.106369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f23411-7718-4ecf-be6d-214394e01fe5 None admin] RBAC: Authorizing `identity:get_role(role_id=ce1cbac653a64c268855a459ce0aae34)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:26.107732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f23411-7718-4ecf-be6d-214394e01fe5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:26.109146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 562/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:25 2022] GET /identity/v3/roles/ce1cbac653a64c268855a459ce0aae34 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:26.115253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987106a-9eb0-40d7-b5d9-ff4becb44cea None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:26.221584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987106a-9eb0-40d7-b5d9-ff4becb44cea None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:26.259044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c195e64-7e67-49dd-a4f1-add8487fc94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:26.260358 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c195e64-7e67-49dd-a4f1-add8487fc94c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:26.260738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c195e64-7e67-49dd-a4f1-add8487fc94c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:26.261145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c195e64-7e67-49dd-a4f1-add8487fc94c None admin] PATH_INFO: `/v3/users/d56cd6d261f247fcbc0918ec1184fcd7` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:26.284317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c195e64-7e67-49dd-a4f1-add8487fc94c None admin] RBAC: Authorizing `identity:get_user(user_id=d56cd6d261f247fcbc0918ec1184fcd7)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:26.285818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c195e64-7e67-49dd-a4f1-add8487fc94c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:26.287451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 552/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:26 2022] GET /identity/v3/users/d56cd6d261f247fcbc0918ec1184fcd7 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:26.295563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f23411-7718-4ecf-be6d-214394e01fe5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:26.420231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f23411-7718-4ecf-be6d-214394e01fe5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:26.455848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7d555-9f0f-4b96-a169-76a38c0dfe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:26.456541 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7d555-9f0f-4b96-a169-76a38c0dfe77 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:26.456823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7d555-9f0f-4b96-a169-76a38c0dfe77 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:26.457123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7d555-9f0f-4b96-a169-76a38c0dfe77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:26.488357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:26.526900 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7d555-9f0f-4b96-a169-76a38c0dfe77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:26.528352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7d555-9f0f-4b96-a169-76a38c0dfe77 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:26.639659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 563/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:19:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:19:26.646610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c195e64-7e67-49dd-a4f1-add8487fc94c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:26.703401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:26.766936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c195e64-7e67-49dd-a4f1-add8487fc94c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:26.806535 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b66d6-c3e7-4d36-bd0d-a77b01901878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:26.807404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b66d6-c3e7-4d36-bd0d-a77b01901878 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:26.807692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b66d6-c3e7-4d36-bd0d-a77b01901878 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:26.808018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b66d6-c3e7-4d36-bd0d-a77b01901878 None admin] PATH_INFO: `/v3/projects/6471e5bd425640a793ea5d0f0abaa013` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:26.810095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b66d6-c3e7-4d36-bd0d-a77b01901878 None admin] RBAC: Authorizing `identity:get_project(project_id=6471e5bd425640a793ea5d0f0abaa013)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:26.812377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b66d6-c3e7-4d36-bd0d-a77b01901878 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:26.815009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 553/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:19:26 2022] GET /identity/v3/projects/6471e5bd425640a793ea5d0f0abaa013 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:26.821330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7d555-9f0f-4b96-a169-76a38c0dfe77 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:26.885430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:26.928626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7d555-9f0f-4b96-a169-76a38c0dfe77 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:26.965155 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f87ab-5b40-47db-b448-4a93aa183897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:26.965805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f87ab-5b40-47db-b448-4a93aa183897 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:26.966086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f87ab-5b40-47db-b448-4a93aa183897 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:26.966364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f87ab-5b40-47db-b448-4a93aa183897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:26.967197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f87ab-5b40-47db-b448-4a93aa183897 None admin] RBAC: Adding query filter params (role.id=ce1cbac653a64c268855a459ce0aae34, scope.project.id=6471e5bd425640a793ea5d0f0abaa013, user.id=d56cd6d261f247fcbc0918ec1184fcd7) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:26.967508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f87ab-5b40-47db-b448-4a93aa183897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:26.968950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f87ab-5b40-47db-b448-4a93aa183897 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:26.974647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 564/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:19:26 2022] GET /identity/v3/role_assignments?user.id=d56cd6d261f247fcbc0918ec1184fcd7&scope.project.id=6471e5bd425640a793ea5d0f0abaa013&role.id=ce1cbac653a64c268855a459ce0aae34 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:28.959146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611a8c-ae91-4acb-8b40-6529b9e67b73 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:28.960028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611a8c-ae91-4acb-8b40-6529b9e67b73 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:28.960028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611a8c-ae91-4acb-8b40-6529b9e67b73 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:28.962202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 554/1118] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:28.968599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add97eae-98f6-4337-86e7-22e49e355a39 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:28.969343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add97eae-98f6-4337-86e7-22e49e355a39 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:28.969533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add97eae-98f6-4337-86e7-22e49e355a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:28.994479 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-add97eae-98f6-4337-86e7-22e49e355a39 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:28.995660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-add97eae-98f6-4337-86e7-22e49e355a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:29.066893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 565/1119] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:29.089344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8611a8c-ae91-4acb-8b40-6529b9e67b73 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:29.207144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8611a8c-ae91-4acb-8b40-6529b9e67b73 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:29.217665 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:29.242458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8423c17-1a61-4e49-a47f-51a08b2f1058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:29.243304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8423c17-1a61-4e49-a47f-51a08b2f1058 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:29.243584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8423c17-1a61-4e49-a47f-51a08b2f1058 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:29.243857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8423c17-1a61-4e49-a47f-51a08b2f1058 None admin] PATH_INFO: `/v3/roles/ce1cbac653a64c268855a459ce0aae34` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:29.245412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8423c17-1a61-4e49-a47f-51a08b2f1058 None admin] RBAC: Authorizing `identity:get_role(role_id=ce1cbac653a64c268855a459ce0aae34)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:29.246781 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8423c17-1a61-4e49-a47f-51a08b2f1058 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:29.248137 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 555/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:29 2022] GET /identity/v3/roles/ce1cbac653a64c268855a459ce0aae34 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:29.255504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add97eae-98f6-4337-86e7-22e49e355a39 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:29.323028 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:29.377520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add97eae-98f6-4337-86e7-22e49e355a39 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:29.416146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a06c-8371-4bc1-8d7c-83d11a110ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:29.417058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a06c-8371-4bc1-8d7c-83d11a110ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:29.417327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a06c-8371-4bc1-8d7c-83d11a110ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:29.417595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a06c-8371-4bc1-8d7c-83d11a110ad7 None admin] PATH_INFO: `/v3/users/d56cd6d261f247fcbc0918ec1184fcd7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:29.418934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7a06c-8371-4bc1-8d7c-83d11a110ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=d56cd6d261f247fcbc0918ec1184fcd7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:29.420367 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7a06c-8371-4bc1-8d7c-83d11a110ad7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:29.422065 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 566/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:29 2022] GET /identity/v3/users/d56cd6d261f247fcbc0918ec1184fcd7 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:29.431421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8423c17-1a61-4e49-a47f-51a08b2f1058 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:29.538920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8423c17-1a61-4e49-a47f-51a08b2f1058 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:29.574261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2fcb5-a437-4f2b-b97a-8c0778467fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:29.575111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2fcb5-a437-4f2b-b97a-8c0778467fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:29.575390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2fcb5-a437-4f2b-b97a-8c0778467fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:29.575659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2fcb5-a437-4f2b-b97a-8c0778467fd3 None admin] PATH_INFO: `/v3/projects/6471e5bd425640a793ea5d0f0abaa013` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:29.576987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2fcb5-a437-4f2b-b97a-8c0778467fd3 None admin] RBAC: Authorizing `identity:get_project(project_id=6471e5bd425640a793ea5d0f0abaa013)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:29.578429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2fcb5-a437-4f2b-b97a-8c0778467fd3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:29.580106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 556/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:19:29 2022] GET /identity/v3/projects/6471e5bd425640a793ea5d0f0abaa013 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:29.586769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a06c-8371-4bc1-8d7c-83d11a110ad7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:29.692762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a06c-8371-4bc1-8d7c-83d11a110ad7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:29.719343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:29.729626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8ab5e-803e-4817-b0f3-406e18309da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:29.730516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8ab5e-803e-4817-b0f3-406e18309da8 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:29.730793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8ab5e-803e-4817-b0f3-406e18309da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:29.731051 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8ab5e-803e-4817-b0f3-406e18309da8 None admin] PATH_INFO: `/v3/projects/6471e5bd425640a793ea5d0f0abaa013/users/d56cd6d261f247fcbc0918ec1184fcd7/roles/ce1cbac653a64c268855a459ce0aae34` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:29.733668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8ab5e-803e-4817-b0f3-406e18309da8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6471e5bd425640a793ea5d0f0abaa013, user_id=d56cd6d261f247fcbc0918ec1184fcd7, role_id=ce1cbac653a64c268855a459ce0aae34)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:29.735099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8ab5e-803e-4817-b0f3-406e18309da8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:29.749989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 567/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:19:29 2022] PUT /identity/v3/projects/6471e5bd425640a793ea5d0f0abaa013/users/d56cd6d261f247fcbc0918ec1184fcd7/roles/ce1cbac653a64c268855a459ce0aae34 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:19:31.738897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef9b0-927b-4e57-87b6-5af9132b170b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:31.739868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef9b0-927b-4e57-87b6-5af9132b170b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:31.739868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef9b0-927b-4e57-87b6-5af9132b170b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:31.741996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 557/1124] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:31.749844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9204-67d7-4f12-9e6a-d801ff4ad377 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:31.750306 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9204-67d7-4f12-9e6a-d801ff4ad377 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:31.750404 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9204-67d7-4f12-9e6a-d801ff4ad377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:31.769227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cbfd9204-67d7-4f12-9e6a-d801ff4ad377 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:31.770393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cbfd9204-67d7-4f12-9e6a-d801ff4ad377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:31.845909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 568/1125] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:19:31.869589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ef9b0-927b-4e57-87b6-5af9132b170b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:31.920569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:31.975525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ef9b0-927b-4e57-87b6-5af9132b170b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:32.011032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989aa6e9-01fc-4840-ae69-57d7a11a458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:32.011819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aa6e9-01fc-4840-ae69-57d7a11a458e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:32.012097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aa6e9-01fc-4840-ae69-57d7a11a458e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:32.012369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aa6e9-01fc-4840-ae69-57d7a11a458e None admin] PATH_INFO: `/v3/roles/ce1cbac653a64c268855a459ce0aae34` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:32.013971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989aa6e9-01fc-4840-ae69-57d7a11a458e None admin] RBAC: Authorizing `identity:get_role(role_id=ce1cbac653a64c268855a459ce0aae34)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:32.015341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989aa6e9-01fc-4840-ae69-57d7a11a458e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:32.016686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 558/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:31 2022] GET /identity/v3/roles/ce1cbac653a64c268855a459ce0aae34 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:32.022804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9204-67d7-4f12-9e6a-d801ff4ad377 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:32.139599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9204-67d7-4f12-9e6a-d801ff4ad377 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:32.156126 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:32.177170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cf45c-d145-4b37-80e4-2b26efe7d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:32.178057 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cf45c-d145-4b37-80e4-2b26efe7d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:32.178336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cf45c-d145-4b37-80e4-2b26efe7d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:32.178604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cf45c-d145-4b37-80e4-2b26efe7d1d7 None admin] PATH_INFO: `/v3/users/d56cd6d261f247fcbc0918ec1184fcd7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:32.179804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cf45c-d145-4b37-80e4-2b26efe7d1d7 None admin] RBAC: Authorizing `identity:get_user(user_id=d56cd6d261f247fcbc0918ec1184fcd7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:32.181274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cf45c-d145-4b37-80e4-2b26efe7d1d7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:32.182906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 569/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:32 2022] GET /identity/v3/users/d56cd6d261f247fcbc0918ec1184fcd7 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:32.189542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989aa6e9-01fc-4840-ae69-57d7a11a458e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:32.291273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989aa6e9-01fc-4840-ae69-57d7a11a458e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:32.305062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:32.329177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05fa96-c842-486e-a759-928656bb576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:32.329839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05fa96-c842-486e-a759-928656bb576c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:32.330119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05fa96-c842-486e-a759-928656bb576c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:32.330378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05fa96-c842-486e-a759-928656bb576c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:32.412706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05fa96-c842-486e-a759-928656bb576c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:32.414470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05fa96-c842-486e-a759-928656bb576c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:32.542483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 559/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:19:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:19:32.549296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cf45c-d145-4b37-80e4-2b26efe7d1d7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:32.652467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cf45c-d145-4b37-80e4-2b26efe7d1d7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:32.687348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fd910-7bd1-4662-801e-f6676b1d68fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:32.688196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fd910-7bd1-4662-801e-f6676b1d68fa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:32.688467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fd910-7bd1-4662-801e-f6676b1d68fa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:32.688732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fd910-7bd1-4662-801e-f6676b1d68fa None admin] PATH_INFO: `/v3/projects/6471e5bd425640a793ea5d0f0abaa013` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:32.690074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fd910-7bd1-4662-801e-f6676b1d68fa None admin] RBAC: Authorizing `identity:get_project(project_id=6471e5bd425640a793ea5d0f0abaa013)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:32.691514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fd910-7bd1-4662-801e-f6676b1d68fa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:32.693236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 570/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:19:32 2022] GET /identity/v3/projects/6471e5bd425640a793ea5d0f0abaa013 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:32.702798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05fa96-c842-486e-a759-928656bb576c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:32.719564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:32.805604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05fa96-c842-486e-a759-928656bb576c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:32.843712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984ec35-1d2a-4064-b1af-6865ec58f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:32.844376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984ec35-1d2a-4064-b1af-6865ec58f5ec None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:32.844655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984ec35-1d2a-4064-b1af-6865ec58f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:32.844924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984ec35-1d2a-4064-b1af-6865ec58f5ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:32.845791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984ec35-1d2a-4064-b1af-6865ec58f5ec None admin] RBAC: Adding query filter params (role.id=ce1cbac653a64c268855a459ce0aae34, scope.project.id=6471e5bd425640a793ea5d0f0abaa013, user.id=d56cd6d261f247fcbc0918ec1184fcd7) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:32.846103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984ec35-1d2a-4064-b1af-6865ec58f5ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:32.847594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984ec35-1d2a-4064-b1af-6865ec58f5ec None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:32.853393 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 560/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:19:32 2022] GET /identity/v3/role_assignments?user.id=d56cd6d261f247fcbc0918ec1184fcd7&scope.project.id=6471e5bd425640a793ea5d0f0abaa013&role.id=ce1cbac653a64c268855a459ce0aae34 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:34.871411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c44ce-3774-4e28-97ec-f55070eb8b02 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:34.871921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c44ce-3774-4e28-97ec-f55070eb8b02 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:34.872030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c44ce-3774-4e28-97ec-f55070eb8b02 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:34.874244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 571/1131] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:34.883209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dcbd5-faec-4066-bcfe-abde3f4e200e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:34.883636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dcbd5-faec-4066-bcfe-abde3f4e200e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:34.883773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dcbd5-faec-4066-bcfe-abde3f4e200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:34.905399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-711dcbd5-faec-4066-bcfe-abde3f4e200e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:34.906607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-711dcbd5-faec-4066-bcfe-abde3f4e200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:34.977779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 561/1132] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:35.000555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c44ce-3774-4e28-97ec-f55070eb8b02 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:35.064229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:35.113211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c44ce-3774-4e28-97ec-f55070eb8b02 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:35.149514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba63687-7eda-4dea-b597-eb809bb1dbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:35.150296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63687-7eda-4dea-b597-eb809bb1dbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:35.150576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63687-7eda-4dea-b597-eb809bb1dbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:35.150850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63687-7eda-4dea-b597-eb809bb1dbc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:35.152078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba63687-7eda-4dea-b597-eb809bb1dbc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:35.153611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba63687-7eda-4dea-b597-eb809bb1dbc6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:35.155296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 572/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:35.162817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dcbd5-faec-4066-bcfe-abde3f4e200e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:35.173202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:35.264633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dcbd5-faec-4066-bcfe-abde3f4e200e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:35.300323 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16251b48-b149-4f88-b71c-9f6d0d4b8118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:35.301068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251b48-b149-4f88-b71c-9f6d0d4b8118 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:35.301429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251b48-b149-4f88-b71c-9f6d0d4b8118 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:35.301532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251b48-b149-4f88-b71c-9f6d0d4b8118 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:35.302250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16251b48-b149-4f88-b71c-9f6d0d4b8118 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:35.303680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16251b48-b149-4f88-b71c-9f6d0d4b8118 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:35.337252 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 562/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:19:35 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:19:37.350967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaecd3-e529-44aa-bf58-9c68391193a2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:37.351550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaecd3-e529-44aa-bf58-9c68391193a2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:37.351550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaecd3-e529-44aa-bf58-9c68391193a2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:37.352895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 573/1135] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:37.359258 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bce9b-7ded-4320-81d2-1882e11adfb5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:37.359963 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bce9b-7ded-4320-81d2-1882e11adfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:37.360138 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bce9b-7ded-4320-81d2-1882e11adfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:37.384618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d86bce9b-7ded-4320-81d2-1882e11adfb5 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:37.385872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d86bce9b-7ded-4320-81d2-1882e11adfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:37.442908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:37.462737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 563/1136] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:37.487279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daaecd3-e529-44aa-bf58-9c68391193a2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:37.599772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daaecd3-e529-44aa-bf58-9c68391193a2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:37.621354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:37.637813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ab49a-c7a8-42e9-93f7-dd583a0264b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:37.638612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ab49a-c7a8-42e9-93f7-dd583a0264b6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:37.638893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ab49a-c7a8-42e9-93f7-dd583a0264b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:37.639163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ab49a-c7a8-42e9-93f7-dd583a0264b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:37.640407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ab49a-c7a8-42e9-93f7-dd583a0264b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:37.641874 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ab49a-c7a8-42e9-93f7-dd583a0264b6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:37.643565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 574/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:19:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:37.649594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bce9b-7ded-4320-81d2-1882e11adfb5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:37.757911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bce9b-7ded-4320-81d2-1882e11adfb5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:37.798834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb837a62-0419-4229-bae7-1f7710bef844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:37.799531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837a62-0419-4229-bae7-1f7710bef844 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:37.799812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837a62-0419-4229-bae7-1f7710bef844 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:37.800091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837a62-0419-4229-bae7-1f7710bef844 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:37.800805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb837a62-0419-4229-bae7-1f7710bef844 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:37.802286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb837a62-0419-4229-bae7-1f7710bef844 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:37.826343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 564/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:19:37 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:19:39.861831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51043c8b-c56a-4f23-b0f8-c3a442849e17 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:39.862421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51043c8b-c56a-4f23-b0f8-c3a442849e17 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:39.862421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51043c8b-c56a-4f23-b0f8-c3a442849e17 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:39.863793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 575/1139] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:39.869544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1ae70-6668-4edf-8619-cd92446e82fe None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:39.870279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1ae70-6668-4edf-8619-cd92446e82fe None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:39.870389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1ae70-6668-4edf-8619-cd92446e82fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:39.895855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a9b1ae70-6668-4edf-8619-cd92446e82fe None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:39.897068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a9b1ae70-6668-4edf-8619-cd92446e82fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:39.941666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:39.970012 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 565/1140] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:39.992869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51043c8b-c56a-4f23-b0f8-c3a442849e17 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:40.100816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51043c8b-c56a-4f23-b0f8-c3a442849e17 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:40.137409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3496c62-78fa-4d04-b3e9-bd8dae5df626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:40.138229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496c62-78fa-4d04-b3e9-bd8dae5df626 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:40.138511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496c62-78fa-4d04-b3e9-bd8dae5df626 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:40.138786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496c62-78fa-4d04-b3e9-bd8dae5df626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:40.150089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3496c62-78fa-4d04-b3e9-bd8dae5df626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d3496c62-78fa-4d04-b3e9-bd8dae5df626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:19:40.157793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:40.158923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:40.159879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 576/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:19:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:40.166104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1ae70-6668-4edf-8619-cd92446e82fe None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:40.268795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1ae70-6668-4edf-8619-cd92446e82fe None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:40.306199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9ed13-900e-4783-8024-2e9f958b62e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:40.306858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9ed13-900e-4783-8024-2e9f958b62e9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:40.307141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9ed13-900e-4783-8024-2e9f958b62e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:40.307410 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9ed13-900e-4783-8024-2e9f958b62e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:40.308161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9ed13-900e-4783-8024-2e9f958b62e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:40.308463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9ed13-900e-4783-8024-2e9f958b62e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:40.309881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9ed13-900e-4783-8024-2e9f958b62e9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:40.318791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 566/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:19:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:40.325422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3496c62-78fa-4d04-b3e9-bd8dae5df626 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:40.382783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:40.437430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3496c62-78fa-4d04-b3e9-bd8dae5df626 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:40.474862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70374d-e6b5-4e99-b348-a2632975b6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:40.475722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70374d-e6b5-4e99-b348-a2632975b6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:40.475994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70374d-e6b5-4e99-b348-a2632975b6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:40.476265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70374d-e6b5-4e99-b348-a2632975b6e7 None admin] PATH_INFO: `/v3/users/bcfd82f0873541ddad3f1e220f1d42e1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:40.490026 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70374d-e6b5-4e99-b348-a2632975b6e7 None admin] RBAC: Authorizing `identity:get_user(user_id=bcfd82f0873541ddad3f1e220f1d42e1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:40.492375 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70374d-e6b5-4e99-b348-a2632975b6e7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:40.494626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 577/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:40 2022] GET /identity/v3/users/bcfd82f0873541ddad3f1e220f1d42e1 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:40.501860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9ed13-900e-4783-8024-2e9f958b62e9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:40.558415 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:40.624617 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9ed13-900e-4783-8024-2e9f958b62e9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:40.658788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f285d9e-fef3-4726-9692-34d65b823126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:40.659361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f285d9e-fef3-4726-9692-34d65b823126 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:40.659635 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f285d9e-fef3-4726-9692-34d65b823126 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:40.659906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f285d9e-fef3-4726-9692-34d65b823126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:40.730220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f285d9e-fef3-4726-9692-34d65b823126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:40.731662 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f285d9e-fef3-4726-9692-34d65b823126 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:40.770339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:40.831562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 567/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:19:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:19:40.837670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70374d-e6b5-4e99-b348-a2632975b6e7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:40.945812 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70374d-e6b5-4e99-b348-a2632975b6e7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:40.953283 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:40.980852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95025f0c-04e4-4b36-b01e-9af3c534716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:40.981753 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025f0c-04e4-4b36-b01e-9af3c534716a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:40.982030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025f0c-04e4-4b36-b01e-9af3c534716a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:40.982295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025f0c-04e4-4b36-b01e-9af3c534716a None admin] PATH_INFO: `/v3/projects/86251c0ef8d34ff880726f18a570b516` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:40.983486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95025f0c-04e4-4b36-b01e-9af3c534716a None admin] RBAC: Authorizing `identity:get_project(project_id=86251c0ef8d34ff880726f18a570b516)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:40.984902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95025f0c-04e4-4b36-b01e-9af3c534716a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:40.986678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 578/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:19:40 2022] GET /identity/v3/projects/86251c0ef8d34ff880726f18a570b516 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:40.992988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f285d9e-fef3-4726-9692-34d65b823126 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:41.099765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f285d9e-fef3-4726-9692-34d65b823126 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:41.133890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6ed4e-b2e0-4dfa-bba6-4a4206a9aba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:41.134525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6ed4e-b2e0-4dfa-bba6-4a4206a9aba2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:41.134800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6ed4e-b2e0-4dfa-bba6-4a4206a9aba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:41.135067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6ed4e-b2e0-4dfa-bba6-4a4206a9aba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:41.135893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6ed4e-b2e0-4dfa-bba6-4a4206a9aba2 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=86251c0ef8d34ff880726f18a570b516, user.id=bcfd82f0873541ddad3f1e220f1d42e1) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:41.136200 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6ed4e-b2e0-4dfa-bba6-4a4206a9aba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:41.137648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6ed4e-b2e0-4dfa-bba6-4a4206a9aba2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:41.143162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 568/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:19:40 2022] GET /identity/v3/role_assignments?user.id=bcfd82f0873541ddad3f1e220f1d42e1&scope.project.id=86251c0ef8d34ff880726f18a570b516&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:43.122394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845f9e6-03d1-4141-8f04-6357115174ce None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:43.123233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845f9e6-03d1-4141-8f04-6357115174ce None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:43.123233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845f9e6-03d1-4141-8f04-6357115174ce None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:43.125407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 579/1147] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:43.132264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af67dcb-2f45-4e95-b7c5-a806409e6893 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:43.133024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af67dcb-2f45-4e95-b7c5-a806409e6893 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:43.133205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af67dcb-2f45-4e95-b7c5-a806409e6893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:43.142120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:43.155426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8af67dcb-2f45-4e95-b7c5-a806409e6893 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:43.156621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8af67dcb-2f45-4e95-b7c5-a806409e6893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:43.232852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 569/1148] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:43.257623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845f9e6-03d1-4141-8f04-6357115174ce None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:43.380838 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845f9e6-03d1-4141-8f04-6357115174ce None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:43.417566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5b017-be20-4350-a489-d268ee3b2554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:43.418347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5b017-be20-4350-a489-d268ee3b2554 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:43.418629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5b017-be20-4350-a489-d268ee3b2554 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:43.418902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5b017-be20-4350-a489-d268ee3b2554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:43.429894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5b017-be20-4350-a489-d268ee3b2554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a6c5b017-be20-4350-a489-d268ee3b2554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:19:43.437495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:43.438543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:43.439544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 580/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:19:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:43.445075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af67dcb-2f45-4e95-b7c5-a806409e6893 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:43.558370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af67dcb-2f45-4e95-b7c5-a806409e6893 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:43.590017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:43.596977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20f595-3da8-4459-9039-17bdfefd621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:43.597668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f595-3da8-4459-9039-17bdfefd621c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:43.597943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f595-3da8-4459-9039-17bdfefd621c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:43.598214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f595-3da8-4459-9039-17bdfefd621c None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:43.598966 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f595-3da8-4459-9039-17bdfefd621c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:43.599269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f595-3da8-4459-9039-17bdfefd621c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:43.600652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f595-3da8-4459-9039-17bdfefd621c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:43.609369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 570/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:19:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:43.615684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5b017-be20-4350-a489-d268ee3b2554 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:43.653657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:43.721940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5b017-be20-4350-a489-d268ee3b2554 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:43.757353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b4b7-6045-477e-a75e-c930b25d6672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:43.758244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b4b7-6045-477e-a75e-c930b25d6672 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:43.758530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b4b7-6045-477e-a75e-c930b25d6672 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:43.758800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b4b7-6045-477e-a75e-c930b25d6672 None admin] PATH_INFO: `/v3/users/bcfd82f0873541ddad3f1e220f1d42e1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:43.760109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94b4b7-6045-477e-a75e-c930b25d6672 None admin] RBAC: Authorizing `identity:get_user(user_id=bcfd82f0873541ddad3f1e220f1d42e1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:43.761577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94b4b7-6045-477e-a75e-c930b25d6672 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:43.763264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 581/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:43 2022] GET /identity/v3/users/bcfd82f0873541ddad3f1e220f1d42e1 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:43.770165 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20f595-3da8-4459-9039-17bdfefd621c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:43.892561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20f595-3da8-4459-9039-17bdfefd621c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:43.927259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f72ea5-5469-43e5-b058-e27ab4d10b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:43.928082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72ea5-5469-43e5-b058-e27ab4d10b99 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:43.928363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72ea5-5469-43e5-b058-e27ab4d10b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:43.928639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72ea5-5469-43e5-b058-e27ab4d10b99 None admin] PATH_INFO: `/v3/projects/86251c0ef8d34ff880726f18a570b516` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:43.929911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f72ea5-5469-43e5-b058-e27ab4d10b99 None admin] RBAC: Authorizing `identity:get_project(project_id=86251c0ef8d34ff880726f18a570b516)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:43.931382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f72ea5-5469-43e5-b058-e27ab4d10b99 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:43.933167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 571/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:19:43 2022] GET /identity/v3/projects/86251c0ef8d34ff880726f18a570b516 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:43.943254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b4b7-6045-477e-a75e-c930b25d6672 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:44.055422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b4b7-6045-477e-a75e-c930b25d6672 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:44.056995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:44.094008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabbd44-2497-4773-bf35-bed454bcafa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:44.094896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabbd44-2497-4773-bf35-bed454bcafa3 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:44.095181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabbd44-2497-4773-bf35-bed454bcafa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:44.095456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabbd44-2497-4773-bf35-bed454bcafa3 None admin] PATH_INFO: `/v3/projects/86251c0ef8d34ff880726f18a570b516/users/bcfd82f0873541ddad3f1e220f1d42e1/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:44.097725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabbd44-2497-4773-bf35-bed454bcafa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=86251c0ef8d34ff880726f18a570b516, user_id=bcfd82f0873541ddad3f1e220f1d42e1, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:44.099166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabbd44-2497-4773-bf35-bed454bcafa3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:44.115572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 582/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:19:43 2022] PUT /identity/v3/projects/86251c0ef8d34ff880726f18a570b516/users/bcfd82f0873541ddad3f1e220f1d42e1/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:19:46.081063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dac54-9b75-4dc2-8c24-a9e234247e7a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:46.081586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dac54-9b75-4dc2-8c24-a9e234247e7a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:46.081586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dac54-9b75-4dc2-8c24-a9e234247e7a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:46.083642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 572/1154] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:46.092407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b0d80-c015-48f4-8d39-90c0dfc2a83f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:46.092810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b0d80-c015-48f4-8d39-90c0dfc2a83f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:46.093049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b0d80-c015-48f4-8d39-90c0dfc2a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:46.117713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e78b0d80-c015-48f4-8d39-90c0dfc2a83f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:46.118924 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e78b0d80-c015-48f4-8d39-90c0dfc2a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:46.188675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 583/1155] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:46.212705 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dac54-9b75-4dc2-8c24-a9e234247e7a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:46.295647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:46.335946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dac54-9b75-4dc2-8c24-a9e234247e7a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:46.371235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be8574-a053-4b40-bf91-cd08cef2d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:46.372021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be8574-a053-4b40-bf91-cd08cef2d347 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:46.372300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be8574-a053-4b40-bf91-cd08cef2d347 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:46.372569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be8574-a053-4b40-bf91-cd08cef2d347 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:46.383908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be8574-a053-4b40-bf91-cd08cef2d347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-94be8574-a053-4b40-bf91-cd08cef2d347 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:19:46.391498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:46.392561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:46.393630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 573/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:19:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:46.399243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b0d80-c015-48f4-8d39-90c0dfc2a83f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:46.494471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:46.508296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b0d80-c015-48f4-8d39-90c0dfc2a83f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:46.553503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1903-7f98-40f6-ae9a-4513f843525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:46.554178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1903-7f98-40f6-ae9a-4513f843525f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:46.554458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1903-7f98-40f6-ae9a-4513f843525f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:46.554729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1903-7f98-40f6-ae9a-4513f843525f None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:46.555484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f1903-7f98-40f6-ae9a-4513f843525f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:46.555789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f1903-7f98-40f6-ae9a-4513f843525f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:46.557196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f1903-7f98-40f6-ae9a-4513f843525f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:46.566595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 584/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:19:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:46.575012 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be8574-a053-4b40-bf91-cd08cef2d347 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:46.688049 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be8574-a053-4b40-bf91-cd08cef2d347 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:46.711297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:46.724672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37216d85-7041-41c5-9786-436b8f487eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:46.725591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37216d85-7041-41c5-9786-436b8f487eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:46.725876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37216d85-7041-41c5-9786-436b8f487eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:46.726151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37216d85-7041-41c5-9786-436b8f487eb2 None admin] PATH_INFO: `/v3/users/bcfd82f0873541ddad3f1e220f1d42e1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:46.727364 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37216d85-7041-41c5-9786-436b8f487eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=bcfd82f0873541ddad3f1e220f1d42e1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:46.728797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37216d85-7041-41c5-9786-436b8f487eb2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:46.730491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 574/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:19:46 2022] GET /identity/v3/users/bcfd82f0873541ddad3f1e220f1d42e1 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:46.739119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1903-7f98-40f6-ae9a-4513f843525f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:46.854671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1903-7f98-40f6-ae9a-4513f843525f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:46.904231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406f03e-393f-47d5-a52c-0406b232037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:46.904869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f03e-393f-47d5-a52c-0406b232037d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:46.905182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f03e-393f-47d5-a52c-0406b232037d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:46.905451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f03e-393f-47d5-a52c-0406b232037d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:46.929561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:46.974867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406f03e-393f-47d5-a52c-0406b232037d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:46.976313 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406f03e-393f-47d5-a52c-0406b232037d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:47.076311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 585/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:19:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:19:47.085521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37216d85-7041-41c5-9786-436b8f487eb2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:47.198768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37216d85-7041-41c5-9786-436b8f487eb2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:47.233860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa24eb-ab94-4302-9d5f-763b9b11e4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:47.234652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa24eb-ab94-4302-9d5f-763b9b11e4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:47.234929 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa24eb-ab94-4302-9d5f-763b9b11e4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:47.235197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa24eb-ab94-4302-9d5f-763b9b11e4f1 None admin] PATH_INFO: `/v3/projects/86251c0ef8d34ff880726f18a570b516` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:47.236495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa24eb-ab94-4302-9d5f-763b9b11e4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=86251c0ef8d34ff880726f18a570b516)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:47.237995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa24eb-ab94-4302-9d5f-763b9b11e4f1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:47.239666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 575/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:19:47 2022] GET /identity/v3/projects/86251c0ef8d34ff880726f18a570b516 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:47.246736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406f03e-393f-47d5-a52c-0406b232037d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:47.303835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:47.362704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406f03e-393f-47d5-a52c-0406b232037d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:47.401333 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9510db-741d-45e9-be91-f62c35852b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:47.401982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9510db-741d-45e9-be91-f62c35852b36 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:47.402264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9510db-741d-45e9-be91-f62c35852b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:47.402535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9510db-741d-45e9-be91-f62c35852b36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:47.403372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9510db-741d-45e9-be91-f62c35852b36 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=86251c0ef8d34ff880726f18a570b516, user.id=bcfd82f0873541ddad3f1e220f1d42e1) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:47.403683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9510db-741d-45e9-be91-f62c35852b36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:47.405147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9510db-741d-45e9-be91-f62c35852b36 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:47.411162 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 586/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:19:47 2022] GET /identity/v3/role_assignments?user.id=bcfd82f0873541ddad3f1e220f1d42e1&scope.project.id=86251c0ef8d34ff880726f18a570b516&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:49.458081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549c174-9d9b-412f-b2a7-e2214df45833 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:49.459037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549c174-9d9b-412f-b2a7-e2214df45833 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:49.459037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549c174-9d9b-412f-b2a7-e2214df45833 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:49.461185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 576/1162] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:49.466701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e7ef-c38f-4f1c-b3d2-8ba247e43a0e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:49.467141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e7ef-c38f-4f1c-b3d2-8ba247e43a0e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:49.467244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e7ef-c38f-4f1c-b3d2-8ba247e43a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:49.485676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1ca9e7ef-c38f-4f1c-b3d2-8ba247e43a0e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:49.486893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1ca9e7ef-c38f-4f1c-b3d2-8ba247e43a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:49.555885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 587/1163] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:49.578610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549c174-9d9b-412f-b2a7-e2214df45833 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:49.646810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:49.691979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549c174-9d9b-412f-b2a7-e2214df45833 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:49.726129 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524d5fa-fc3a-437c-af73-72af284ae353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:49.726773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524d5fa-fc3a-437c-af73-72af284ae353 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:49.727046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524d5fa-fc3a-437c-af73-72af284ae353 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:49.727288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524d5fa-fc3a-437c-af73-72af284ae353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:49.804451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524d5fa-fc3a-437c-af73-72af284ae353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:49.806017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524d5fa-fc3a-437c-af73-72af284ae353 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:49.872304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:49.922816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 577/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:19:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:19:49.931254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9e7ef-c38f-4f1c-b3d2-8ba247e43a0e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:49.979634 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:50.031224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9e7ef-c38f-4f1c-b3d2-8ba247e43a0e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:50.066207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119f259-aff9-4d7f-a913-1e8f3fb45288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:50.067014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119f259-aff9-4d7f-a913-1e8f3fb45288 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:50.067294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119f259-aff9-4d7f-a913-1e8f3fb45288 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:50.067564 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119f259-aff9-4d7f-a913-1e8f3fb45288 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:50.075035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119f259-aff9-4d7f-a913-1e8f3fb45288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:50.076509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119f259-aff9-4d7f-a913-1e8f3fb45288 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c119f259-aff9-4d7f-a913-1e8f3fb45288 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:50.091258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:50.092417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:19:50.094150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 588/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jul 6 20:19:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:50.099676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524d5fa-fc3a-437c-af73-72af284ae353 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:50.203031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524d5fa-fc3a-437c-af73-72af284ae353 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:50.237924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78422-56d0-4d20-ba6f-04d861c1e788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:50.238523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78422-56d0-4d20-ba6f-04d861c1e788 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:50.238806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78422-56d0-4d20-ba6f-04d861c1e788 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:50.239080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78422-56d0-4d20-ba6f-04d861c1e788 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:50.239808 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da78422-56d0-4d20-ba6f-04d861c1e788 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:19:50.240116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da78422-56d0-4d20-ba6f-04d861c1e788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:50.241518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da78422-56d0-4d20-ba6f-04d861c1e788 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:50.248888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 578/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Wed Jul 6 20:19:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:52.215237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7e07-a4a6-425b-be8a-e93458aac72c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:52.215800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7e07-a4a6-425b-be8a-e93458aac72c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:52.215800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7e07-a4a6-425b-be8a-e93458aac72c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:52.217204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 589/1167] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:52.222725 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8958aff-36e4-4614-b83f-537a9d8da894 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:52.223168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8958aff-36e4-4614-b83f-537a9d8da894 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:52.223259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8958aff-36e4-4614-b83f-537a9d8da894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:52.242267 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e8958aff-36e4-4614-b83f-537a9d8da894 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:52.243427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e8958aff-36e4-4614-b83f-537a9d8da894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:52.261234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:52.320416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 579/1168] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:19:52.343374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7e07-a4a6-425b-be8a-e93458aac72c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:52.467294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7e07-a4a6-425b-be8a-e93458aac72c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:52.475936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:52.504013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9f6fe-063b-44fa-aa0f-09d4178647a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:52.504653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9f6fe-063b-44fa-aa0f-09d4178647a3 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:52.504930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9f6fe-063b-44fa-aa0f-09d4178647a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:52.505236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9f6fe-063b-44fa-aa0f-09d4178647a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:52.506002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9f6fe-063b-44fa-aa0f-09d4178647a3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:52.507371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9f6fe-063b-44fa-aa0f-09d4178647a3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:52.528128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 590/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Wed Jul 6 20:19:52 2022] POST /identity/v3/domains => generated 267 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:19:54.548028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af634-14be-4ee0-b89c-6dde0c964ae3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:54.548616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af634-14be-4ee0-b89c-6dde0c964ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:54.548616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af634-14be-4ee0-b89c-6dde0c964ae3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:54.550020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 580/1170] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:54.556396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf5e84-e8ca-480a-9925-a1eb8c39e230 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:54.557082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf5e84-e8ca-480a-9925-a1eb8c39e230 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:54.557288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf5e84-e8ca-480a-9925-a1eb8c39e230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:54.578128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-71bf5e84-e8ca-480a-9925-a1eb8c39e230 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:54.579330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-71bf5e84-e8ca-480a-9925-a1eb8c39e230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:54.657492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 591/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:54.681432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07af634-14be-4ee0-b89c-6dde0c964ae3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:54.796706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07af634-14be-4ee0-b89c-6dde0c964ae3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:54.837103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9c4c9-f1ec-4a72-a8db-35c194b72eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:54.838003 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9c4c9-f1ec-4a72-a8db-35c194b72eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:54.838284 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9c4c9-f1ec-4a72-a8db-35c194b72eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:54.838558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9c4c9-f1ec-4a72-a8db-35c194b72eb4 None admin] PATH_INFO: `/v3/domains/e1e3fbf379d946e59a7c3e5890dab222` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:54.849369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9c4c9-f1ec-4a72-a8db-35c194b72eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e1e3fbf379d946e59a7c3e5890dab222)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:54.850824 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9c4c9-f1ec-4a72-a8db-35c194b72eb4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:54.852465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 581/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Wed Jul 6 20:19:54 2022] GET /identity/v3/domains/e1e3fbf379d946e59a7c3e5890dab222 => generated 267 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:54.858871 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf5e84-e8ca-480a-9925-a1eb8c39e230 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:54.958533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:54.964567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf5e84-e8ca-480a-9925-a1eb8c39e230 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:55.009735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bcde3-7159-4db1-b837-9fab3241f9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:55.010395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bcde3-7159-4db1-b837-9fab3241f9d3 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:55.010679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bcde3-7159-4db1-b837-9fab3241f9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:55.010952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bcde3-7159-4db1-b837-9fab3241f9d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:55.011655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bcde3-7159-4db1-b837-9fab3241f9d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:55.013118 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bcde3-7159-4db1-b837-9fab3241f9d3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:55.047718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 592/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:19:54 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:19:57.079961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe5505-db09-4676-851e-3200add8060a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:57.080554 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe5505-db09-4676-851e-3200add8060a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:57.080554 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe5505-db09-4676-851e-3200add8060a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:57.081894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 582/1174] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:57.088130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7834ed-515d-4afd-b3c3-5c884a3ddccc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:57.088816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7834ed-515d-4afd-b3c3-5c884a3ddccc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:57.089038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7834ed-515d-4afd-b3c3-5c884a3ddccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:57.114839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6f7834ed-515d-4afd-b3c3-5c884a3ddccc None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:57.116043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6f7834ed-515d-4afd-b3c3-5c884a3ddccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:57.192689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 593/1175] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:57.218484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe5505-db09-4676-851e-3200add8060a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:57.241357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:57.340784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe5505-db09-4676-851e-3200add8060a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:57.376275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d608b2f-3cd3-40c5-b597-f2b42dd72266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:57.377205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d608b2f-3cd3-40c5-b597-f2b42dd72266 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:57.377518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d608b2f-3cd3-40c5-b597-f2b42dd72266 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:57.377787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d608b2f-3cd3-40c5-b597-f2b42dd72266 None admin] PATH_INFO: `/v3/domains/e1e3fbf379d946e59a7c3e5890dab222` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:57.379453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d608b2f-3cd3-40c5-b597-f2b42dd72266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e1e3fbf379d946e59a7c3e5890dab222)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:57.380880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d608b2f-3cd3-40c5-b597-f2b42dd72266 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:57.382526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 583/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Wed Jul 6 20:19:57 2022] GET /identity/v3/domains/e1e3fbf379d946e59a7c3e5890dab222 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:19:57.388709 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7834ed-515d-4afd-b3c3-5c884a3ddccc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:57.474127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:57.496204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7834ed-515d-4afd-b3c3-5c884a3ddccc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:57.531425 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd30b09-c905-48f3-a3e3-702cdd48051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:57.532086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30b09-c905-48f3-a3e3-702cdd48051f None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:57.532368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30b09-c905-48f3-a3e3-702cdd48051f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:57.532638 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30b09-c905-48f3-a3e3-702cdd48051f None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:57.533478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd30b09-c905-48f3-a3e3-702cdd48051f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:19:57.534914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd30b09-c905-48f3-a3e3-702cdd48051f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:19:57.557723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 594/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:19:57 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:19:59.616152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6343-c849-47bb-8ad8-c60e3959cd57 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:59.616716 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6343-c849-47bb-8ad8-c60e3959cd57 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:59.616716 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6343-c849-47bb-8ad8-c60e3959cd57 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:59.618864 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 584/1178] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:19:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:19:59.627686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc4fb-19f4-45ef-b255-14d0f0567bea None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:59.628089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc4fb-19f4-45ef-b255-14d0f0567bea None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:59.628668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc4fb-19f4-45ef-b255-14d0f0567bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:59.651833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a62fc4fb-19f4-45ef-b255-14d0f0567bea None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:19:59.653047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a62fc4fb-19f4-45ef-b255-14d0f0567bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:19:59.730195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 595/1179] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:19:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:19:59.753852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd6343-c849-47bb-8ad8-c60e3959cd57 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:19:59.853227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:19:59.874330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd6343-c849-47bb-8ad8-c60e3959cd57 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:19:59.910237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013abb7-a762-422d-b18f-db4517af1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:19:59.911020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013abb7-a762-422d-b18f-db4517af1e85 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:19:59.911291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013abb7-a762-422d-b18f-db4517af1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:19:59.911559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013abb7-a762-422d-b18f-db4517af1e85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:19:59.922182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013abb7-a762-422d-b18f-db4517af1e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a013abb7-a762-422d-b18f-db4517af1e85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:19:59.929724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:19:59.930934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:19:59.931977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 585/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:19:59.939828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fc4fb-19f4-45ef-b255-14d0f0567bea None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:00.009853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:00.055956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fc4fb-19f4-45ef-b255-14d0f0567bea None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:00.091262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ca1f5-9216-48e3-9f94-444079df58e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:00.091908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca1f5-9216-48e3-9f94-444079df58e6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:00.092183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca1f5-9216-48e3-9f94-444079df58e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:00.092451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca1f5-9216-48e3-9f94-444079df58e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:00.093224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ca1f5-9216-48e3-9f94-444079df58e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:20:00.093530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ca1f5-9216-48e3-9f94-444079df58e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:00.094886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ca1f5-9216-48e3-9f94-444079df58e6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:00.103470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 596/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:19:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:20:00.110083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013abb7-a762-422d-b18f-db4517af1e85 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:00.220935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013abb7-a762-422d-b18f-db4517af1e85 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:00.255893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43356d8-43bd-4a4f-934d-73131bb5e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:00.256750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43356d8-43bd-4a4f-934d-73131bb5e712 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:00.257013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43356d8-43bd-4a4f-934d-73131bb5e712 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:00.257314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43356d8-43bd-4a4f-934d-73131bb5e712 None admin] PATH_INFO: `/v3/users/291892f94f53407bae191a8159eabc31` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:00.268015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:00.271658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43356d8-43bd-4a4f-934d-73131bb5e712 None admin] RBAC: Authorizing `identity:get_user(user_id=291892f94f53407bae191a8159eabc31)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:00.273412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43356d8-43bd-4a4f-934d-73131bb5e712 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:00.275057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 586/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:20:00 2022] GET /identity/v3/users/291892f94f53407bae191a8159eabc31 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:20:00.281859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ca1f5-9216-48e3-9f94-444079df58e6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:00.396501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ca1f5-9216-48e3-9f94-444079df58e6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:00.423176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:00.432929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9e6a1-b2fc-4229-a87c-969f71166246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:00.433652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9e6a1-b2fc-4229-a87c-969f71166246 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:00.433972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9e6a1-b2fc-4229-a87c-969f71166246 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:00.434273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9e6a1-b2fc-4229-a87c-969f71166246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:00.507577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9e6a1-b2fc-4229-a87c-969f71166246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:00.508993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9e6a1-b2fc-4229-a87c-969f71166246 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:00.615340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 597/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:20:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:20:00.624826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43356d8-43bd-4a4f-934d-73131bb5e712 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:00.735963 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43356d8-43bd-4a4f-934d-73131bb5e712 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:00.771148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5034c73-6835-4b59-ace5-59c854c3b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:00.771930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034c73-6835-4b59-ace5-59c854c3b873 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:00.772209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034c73-6835-4b59-ace5-59c854c3b873 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:00.772479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034c73-6835-4b59-ace5-59c854c3b873 None admin] PATH_INFO: `/v3/projects/691f8438157b44f9b478aa7625384098` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:00.773759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5034c73-6835-4b59-ace5-59c854c3b873 None admin] RBAC: Authorizing `identity:get_project(project_id=691f8438157b44f9b478aa7625384098)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:00.775188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5034c73-6835-4b59-ace5-59c854c3b873 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:00.776884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 587/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:20:00 2022] GET /identity/v3/projects/691f8438157b44f9b478aa7625384098 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:20:00.783906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9e6a1-b2fc-4229-a87c-969f71166246 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:00.819560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:00.904456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9e6a1-b2fc-4229-a87c-969f71166246 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:00.941200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47947ccc-921b-43fb-8e11-a1ba9b1c8a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:00.941851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47947ccc-921b-43fb-8e11-a1ba9b1c8a06 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:00.942131 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47947ccc-921b-43fb-8e11-a1ba9b1c8a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:00.942399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47947ccc-921b-43fb-8e11-a1ba9b1c8a06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:00.943235 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47947ccc-921b-43fb-8e11-a1ba9b1c8a06 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=691f8438157b44f9b478aa7625384098, user.id=291892f94f53407bae191a8159eabc31) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:20:00.943549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47947ccc-921b-43fb-8e11-a1ba9b1c8a06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:00.945001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47947ccc-921b-43fb-8e11-a1ba9b1c8a06 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:00.950570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 598/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:20:00 2022] GET /identity/v3/role_assignments?user.id=291892f94f53407bae191a8159eabc31&scope.project.id=691f8438157b44f9b478aa7625384098&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:20:02.920480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d7c7e-0ce2-4e8f-b0f8-8342b7ea174d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:02.921058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d7c7e-0ce2-4e8f-b0f8-8342b7ea174d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:02.921058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d7c7e-0ce2-4e8f-b0f8-8342b7ea174d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:02.922447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 588/1186] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:20:02.928916 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a91308-4830-40a2-a7cc-c83a9a020ecc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:02.929668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a91308-4830-40a2-a7cc-c83a9a020ecc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:02.929880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a91308-4830-40a2-a7cc-c83a9a020ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:02.952544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-21a91308-4830-40a2-a7cc-c83a9a020ecc None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:20:02.953795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-21a91308-4830-40a2-a7cc-c83a9a020ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:20:03.034837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 599/1187] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:20:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:20:03.057208 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d7c7e-0ce2-4e8f-b0f8-8342b7ea174d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:03.128882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:03.164969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d7c7e-0ce2-4e8f-b0f8-8342b7ea174d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:03.199921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e296e4-11b9-4d40-8c58-3eabe40bd2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:03.200713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e296e4-11b9-4d40-8c58-3eabe40bd2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:03.201000 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e296e4-11b9-4d40-8c58-3eabe40bd2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:03.201278 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e296e4-11b9-4d40-8c58-3eabe40bd2b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:03.212371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e296e4-11b9-4d40-8c58-3eabe40bd2b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-26e296e4-11b9-4d40-8c58-3eabe40bd2b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:20:03.220134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:20:03.221269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:20:03.222457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 589/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:20:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:20:03.227969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a91308-4830-40a2-a7cc-c83a9a020ecc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:03.255767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:03.332945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a91308-4830-40a2-a7cc-c83a9a020ecc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:03.367758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43043d8-89e4-418a-83a6-09abd65327fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:03.368415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43043d8-89e4-418a-83a6-09abd65327fa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:03.368699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43043d8-89e4-418a-83a6-09abd65327fa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:03.369000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43043d8-89e4-418a-83a6-09abd65327fa None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:03.369739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43043d8-89e4-418a-83a6-09abd65327fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:20:03.370041 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43043d8-89e4-418a-83a6-09abd65327fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:03.371414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43043d8-89e4-418a-83a6-09abd65327fa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:03.380110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 600/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:20:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:20:03.389344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e296e4-11b9-4d40-8c58-3eabe40bd2b1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:03.500829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e296e4-11b9-4d40-8c58-3eabe40bd2b1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:03.526758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:03.539348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e9f79-e123-45b6-bb52-74073407607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:03.540162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e9f79-e123-45b6-bb52-74073407607a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:03.540436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e9f79-e123-45b6-bb52-74073407607a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:03.540704 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e9f79-e123-45b6-bb52-74073407607a None admin] PATH_INFO: `/v3/users/291892f94f53407bae191a8159eabc31` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:03.542001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e9f79-e123-45b6-bb52-74073407607a None admin] RBAC: Authorizing `identity:get_user(user_id=291892f94f53407bae191a8159eabc31)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:03.543480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e9f79-e123-45b6-bb52-74073407607a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:03.545157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 590/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:20:03 2022] GET /identity/v3/users/291892f94f53407bae191a8159eabc31 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:20:03.551443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43043d8-89e4-418a-83a6-09abd65327fa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:03.643853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:03.662203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43043d8-89e4-418a-83a6-09abd65327fa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:03.697450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eabaeb-1f9a-401e-a84c-bc2229534068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:03.698314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eabaeb-1f9a-401e-a84c-bc2229534068 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:03.698591 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eabaeb-1f9a-401e-a84c-bc2229534068 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:03.698861 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eabaeb-1f9a-401e-a84c-bc2229534068 None admin] PATH_INFO: `/v3/projects/691f8438157b44f9b478aa7625384098` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:03.700157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eabaeb-1f9a-401e-a84c-bc2229534068 None admin] RBAC: Authorizing `identity:get_project(project_id=691f8438157b44f9b478aa7625384098)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:03.701636 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eabaeb-1f9a-401e-a84c-bc2229534068 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:03.703353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 601/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:20:03 2022] GET /identity/v3/projects/691f8438157b44f9b478aa7625384098 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:20:03.710736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e9f79-e123-45b6-bb52-74073407607a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:03.822537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e9f79-e123-45b6-bb52-74073407607a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:03.858993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23223f6-b77e-4e1c-a211-bb167ef4c6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:03.859890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23223f6-b77e-4e1c-a211-bb167ef4c6a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:03.860164 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23223f6-b77e-4e1c-a211-bb167ef4c6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:03.860437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23223f6-b77e-4e1c-a211-bb167ef4c6a6 None admin] PATH_INFO: `/v3/projects/691f8438157b44f9b478aa7625384098/users/291892f94f53407bae191a8159eabc31/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:03.862811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23223f6-b77e-4e1c-a211-bb167ef4c6a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=691f8438157b44f9b478aa7625384098, user_id=291892f94f53407bae191a8159eabc31, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:03.864275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23223f6-b77e-4e1c-a211-bb167ef4c6a6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:03.884024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 591/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:20:03 2022] PUT /identity/v3/projects/691f8438157b44f9b478aa7625384098/users/291892f94f53407bae191a8159eabc31/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:20:05.851995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72107f-aa14-4adf-bcd3-8b040fed072d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:05.852729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72107f-aa14-4adf-bcd3-8b040fed072d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:05.852916 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72107f-aa14-4adf-bcd3-8b040fed072d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:05.855187 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 602/1193] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:20:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:20:05.860555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fa6b0-c757-4fc4-94a4-a366aa98c820 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:05.861018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fa6b0-c757-4fc4-94a4-a366aa98c820 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:05.861126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fa6b0-c757-4fc4-94a4-a366aa98c820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:05.880007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7f9fa6b0-c757-4fc4-94a4-a366aa98c820 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:20:05.881230 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7f9fa6b0-c757-4fc4-94a4-a366aa98c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:20:05.931811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:05.951674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 592/1194] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:20:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:20:05.976366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72107f-aa14-4adf-bcd3-8b040fed072d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:06.095862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72107f-aa14-4adf-bcd3-8b040fed072d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:06.132652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a03b14-54c0-4f43-9c66-b59c8b2df3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:06.133466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a03b14-54c0-4f43-9c66-b59c8b2df3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:06.133747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a03b14-54c0-4f43-9c66-b59c8b2df3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:06.134017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a03b14-54c0-4f43-9c66-b59c8b2df3f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:06.145570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a03b14-54c0-4f43-9c66-b59c8b2df3f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-08a03b14-54c0-4f43-9c66-b59c8b2df3f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:20:06.153172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:20:06.154208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:20:06.161967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 603/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:20:06.162768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fa6b0-c757-4fc4-94a4-a366aa98c820 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:06.270175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fa6b0-c757-4fc4-94a4-a366aa98c820 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:06.316565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec3b2e-442e-49b6-b69f-05dd39e13e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:06.317253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec3b2e-442e-49b6-b69f-05dd39e13e0a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:06.317535 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec3b2e-442e-49b6-b69f-05dd39e13e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:06.317803 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec3b2e-442e-49b6-b69f-05dd39e13e0a None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:06.318612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec3b2e-442e-49b6-b69f-05dd39e13e0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:20:06.318916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec3b2e-442e-49b6-b69f-05dd39e13e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:06.320300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec3b2e-442e-49b6-b69f-05dd39e13e0a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:06.328432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 593/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:20:06.334332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a03b14-54c0-4f43-9c66-b59c8b2df3f1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:06.351770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:06.439871 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a03b14-54c0-4f43-9c66-b59c8b2df3f1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:06.486764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35f523-dbe8-424b-8bd4-e09f080ed977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:06.487626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f523-dbe8-424b-8bd4-e09f080ed977 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:06.487904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f523-dbe8-424b-8bd4-e09f080ed977 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:06.488176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f523-dbe8-424b-8bd4-e09f080ed977 None admin] PATH_INFO: `/v3/users/291892f94f53407bae191a8159eabc31` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:06.489506 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35f523-dbe8-424b-8bd4-e09f080ed977 None admin] RBAC: Authorizing `identity:get_user(user_id=291892f94f53407bae191a8159eabc31)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:06.490928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35f523-dbe8-424b-8bd4-e09f080ed977 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:06.492537 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 604/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Wed Jul 6 20:20:06 2022] GET /identity/v3/users/291892f94f53407bae191a8159eabc31 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:20:06.498276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec3b2e-442e-49b6-b69f-05dd39e13e0a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:06.545796 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:06.601095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec3b2e-442e-49b6-b69f-05dd39e13e0a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:06.636651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93a0a6-ce52-4187-bc66-06f73ae3299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:06.637254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a0a6-ce52-4187-bc66-06f73ae3299d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:06.637513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a0a6-ce52-4187-bc66-06f73ae3299d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:06.637807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a0a6-ce52-4187-bc66-06f73ae3299d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:06.708375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93a0a6-ce52-4187-bc66-06f73ae3299d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:06.709848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93a0a6-ce52-4187-bc66-06f73ae3299d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:06.755201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:06.810171 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 594/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:20:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:20:06.816460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35f523-dbe8-424b-8bd4-e09f080ed977 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:06.904856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:06.932757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35f523-dbe8-424b-8bd4-e09f080ed977 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:06.969039 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a2c00-eac0-4c9c-8018-a674f60a289d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:06.969894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2c00-eac0-4c9c-8018-a674f60a289d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:06.970180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2c00-eac0-4c9c-8018-a674f60a289d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:06.970442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2c00-eac0-4c9c-8018-a674f60a289d None admin] PATH_INFO: `/v3/projects/691f8438157b44f9b478aa7625384098` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:06.971751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a2c00-eac0-4c9c-8018-a674f60a289d None admin] RBAC: Authorizing `identity:get_project(project_id=691f8438157b44f9b478aa7625384098)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:06.973209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a2c00-eac0-4c9c-8018-a674f60a289d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:06.974952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 605/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Wed Jul 6 20:20:06 2022] GET /identity/v3/projects/691f8438157b44f9b478aa7625384098 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:20:06.981927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93a0a6-ce52-4187-bc66-06f73ae3299d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:20:07.092919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93a0a6-ce52-4187-bc66-06f73ae3299d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:20:07.129456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed819c-c73f-45db-9bc1-537e0508ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:20:07.130101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed819c-c73f-45db-9bc1-537e0508ef31 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:20:07.130371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed819c-c73f-45db-9bc1-537e0508ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:20:07.130643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed819c-c73f-45db-9bc1-537e0508ef31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:20:07.131471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed819c-c73f-45db-9bc1-537e0508ef31 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=691f8438157b44f9b478aa7625384098, user.id=291892f94f53407bae191a8159eabc31) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:20:07.131775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed819c-c73f-45db-9bc1-537e0508ef31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:20:07.133251 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed819c-c73f-45db-9bc1-537e0508ef31 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:20:07.139791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 595/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:20:06 2022] GET /identity/v3/role_assignments?user.id=291892f94f53407bae191a8159eabc31&scope.project.id=691f8438157b44f9b478aa7625384098&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:20:16.963653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=26 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:20:17.136783 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:02.550619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f7b96-24a2-4099-b10e-c1ec32fa0f22 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:02.550619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f7b96-24a2-4099-b10e-c1ec32fa0f22 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:02.551299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f7b96-24a2-4099-b10e-c1ec32fa0f22 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:02.552534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 606/1201] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:21:02.559221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69a194-f61a-449f-9c54-52796a118617 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:02.559732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69a194-f61a-449f-9c54-52796a118617 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:02.559732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69a194-f61a-449f-9c54-52796a118617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:02.578942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6f69a194-f61a-449f-9c54-52796a118617 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:21:02.580302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6f69a194-f61a-449f-9c54-52796a118617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:21:02.666365 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 596/1202] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:21:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:21:02.698251 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f7b96-24a2-4099-b10e-c1ec32fa0f22 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:02.839936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f7b96-24a2-4099-b10e-c1ec32fa0f22 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:02.891491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cb1aa-0424-4af8-ac80-dfe6e9dc2841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:02.892517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb1aa-0424-4af8-ac80-dfe6e9dc2841 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:02.892867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb1aa-0424-4af8-ac80-dfe6e9dc2841 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:02.893192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb1aa-0424-4af8-ac80-dfe6e9dc2841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:02.906920 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cb1aa-0424-4af8-ac80-dfe6e9dc2841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:02.908677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cb1aa-0424-4af8-ac80-dfe6e9dc2841 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f65cb1aa-0424-4af8-ac80-dfe6e9dc2841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:02.928471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:02.929707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:02.930927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:02.930927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:02.930927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:02.930927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:02.930927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 607/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:02.936562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69a194-f61a-449f-9c54-52796a118617 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:03.061970 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69a194-f61a-449f-9c54-52796a118617 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:03.104248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:03.111882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2f4a4-66cf-46ed-8a6f-720b6df10439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:03.112589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f4a4-66cf-46ed-8a6f-720b6df10439 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:03.112870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f4a4-66cf-46ed-8a6f-720b6df10439 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:03.113174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f4a4-66cf-46ed-8a6f-720b6df10439 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:03.114030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2f4a4-66cf-46ed-8a6f-720b6df10439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:03.114236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2f4a4-66cf-46ed-8a6f-720b6df10439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:03.118823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2f4a4-66cf-46ed-8a6f-720b6df10439 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:03.134135 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 597/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:03.140356 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cb1aa-0424-4af8-ac80-dfe6e9dc2841 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:03.217620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:03.279626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cb1aa-0424-4af8-ac80-dfe6e9dc2841 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:03.324992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fa646-6039-4bf6-b315-d6c8bc24565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:03.325724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa646-6039-4bf6-b315-d6c8bc24565a None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:03.326141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa646-6039-4bf6-b315-d6c8bc24565a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:03.326412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa646-6039-4bf6-b315-d6c8bc24565a None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:03.327194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fa646-6039-4bf6-b315-d6c8bc24565a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:03.328862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fa646-6039-4bf6-b315-d6c8bc24565a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:03.369122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 608/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Wed Jul 6 20:21:03 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:21:05.649894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988588-cae1-4fdb-bfc9-497288579dbf None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:05.650551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988588-cae1-4fdb-bfc9-497288579dbf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:05.650551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988588-cae1-4fdb-bfc9-497288579dbf None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:05.651938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 598/1206] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:21:05.658783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3692-501d-44f9-9a82-0cb3848c2286 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:05.659255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3692-501d-44f9-9a82-0cb3848c2286 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:05.659380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3692-501d-44f9-9a82-0cb3848c2286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:05.677404 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-95fd3692-501d-44f9-9a82-0cb3848c2286 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:21:05.678619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-95fd3692-501d-44f9-9a82-0cb3848c2286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:21:05.754642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 609/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:21:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:21:05.778894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c988588-cae1-4fdb-bfc9-497288579dbf None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:05.904507 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c988588-cae1-4fdb-bfc9-497288579dbf None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:05.941215 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec8a0c-1824-4a57-98e8-e09f00136a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:05.942030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec8a0c-1824-4a57-98e8-e09f00136a87 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:05.942322 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec8a0c-1824-4a57-98e8-e09f00136a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:05.942628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec8a0c-1824-4a57-98e8-e09f00136a87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:05.953440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec8a0c-1824-4a57-98e8-e09f00136a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-12ec8a0c-1824-4a57-98e8-e09f00136a87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:21:05.961324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:05.962350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:05.963196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 599/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:21:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:05.970857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3692-501d-44f9-9a82-0cb3848c2286 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:06.017273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:06.088082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3692-501d-44f9-9a82-0cb3848c2286 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:06.125759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bc0d2-52c6-4edc-ab3d-8817807257f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:06.126459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc0d2-52c6-4edc-ab3d-8817807257f2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:06.126778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc0d2-52c6-4edc-ab3d-8817807257f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:06.127052 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc0d2-52c6-4edc-ab3d-8817807257f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:06.127830 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bc0d2-52c6-4edc-ab3d-8817807257f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:06.128151 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bc0d2-52c6-4edc-ab3d-8817807257f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:06.129672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bc0d2-52c6-4edc-ab3d-8817807257f2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:06.139288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 610/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:21:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:06.145282 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec8a0c-1824-4a57-98e8-e09f00136a87 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:06.205097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:06.261572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec8a0c-1824-4a57-98e8-e09f00136a87 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:06.306910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c539b-b5ab-4c65-80e1-2e236f678063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:06.308166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c539b-b5ab-4c65-80e1-2e236f678063 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:06.308755 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c539b-b5ab-4c65-80e1-2e236f678063 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:06.309036 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c539b-b5ab-4c65-80e1-2e236f678063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:06.323880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c539b-b5ab-4c65-80e1-2e236f678063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:06.325590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c539b-b5ab-4c65-80e1-2e236f678063 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-057c539b-b5ab-4c65-80e1-2e236f678063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:06.345116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:06.346080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:06.347034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:06.347034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:06.347034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:06.347034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:06.347034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 600/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:21:06.352227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bc0d2-52c6-4edc-ab3d-8817807257f2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:06.467271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:06.470666 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bc0d2-52c6-4edc-ab3d-8817807257f2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:06.510960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e373d0-2bdd-4544-b796-e297ccb37de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:06.511709 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e373d0-2bdd-4544-b796-e297ccb37de4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:06.511957 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e373d0-2bdd-4544-b796-e297ccb37de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:06.512315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e373d0-2bdd-4544-b796-e297ccb37de4 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:06.513112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e373d0-2bdd-4544-b796-e297ccb37de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:06.513896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e373d0-2bdd-4544-b796-e297ccb37de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:06.514887 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e373d0-2bdd-4544-b796-e297ccb37de4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:06.529411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 611/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:06.535395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c539b-b5ab-4c65-80e1-2e236f678063 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:06.651262 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c539b-b5ab-4c65-80e1-2e236f678063 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:06.652833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:06.688858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09414bf6-3c61-4a72-b346-ea485acb4fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:06.689789 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09414bf6-3c61-4a72-b346-ea485acb4fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:06.690015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09414bf6-3c61-4a72-b346-ea485acb4fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:06.690285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09414bf6-3c61-4a72-b346-ea485acb4fd4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:06.698393 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09414bf6-3c61-4a72-b346-ea485acb4fd4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:06.700101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09414bf6-3c61-4a72-b346-ea485acb4fd4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-09414bf6-3c61-4a72-b346-ea485acb4fd4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:21:06.715861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:06.716916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:06.718288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:06.718288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:06.718288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:21:06.718288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:21:06.718288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:21:06.718288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:21:06.718288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:21:06.718288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:21:06.718288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:06.718288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:06.721704 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 601/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:06.723026 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e373d0-2bdd-4544-b796-e297ccb37de4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:06.839087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e373d0-2bdd-4544-b796-e297ccb37de4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:06.878945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed612f81-61c4-4aed-aff6-34e81a19f6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:06.879626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed612f81-61c4-4aed-aff6-34e81a19f6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:06.879906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed612f81-61c4-4aed-aff6-34e81a19f6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:06.880183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed612f81-61c4-4aed-aff6-34e81a19f6a1 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:06.881151 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed612f81-61c4-4aed-aff6-34e81a19f6a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:06.882417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed612f81-61c4-4aed-aff6-34e81a19f6a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:06.883018 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed612f81-61c4-4aed-aff6-34e81a19f6a1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:06.901840 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 612/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jul 6 20:21:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:06.908353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09414bf6-3c61-4a72-b346-ea485acb4fd4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:07.031643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09414bf6-3c61-4a72-b346-ea485acb4fd4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:07.073307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bef30-2b9c-4e3c-ac0b-706df54d3006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:07.073984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bef30-2b9c-4e3c-ac0b-706df54d3006 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:07.074237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bef30-2b9c-4e3c-ac0b-706df54d3006 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:07.074531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bef30-2b9c-4e3c-ac0b-706df54d3006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:07.110227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:07.154774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bef30-2b9c-4e3c-ac0b-706df54d3006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:07.156490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bef30-2b9c-4e3c-ac0b-706df54d3006 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:07.274061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 602/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:21:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:21:07.279851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed612f81-61c4-4aed-aff6-34e81a19f6a1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:07.301821 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:07.391621 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed612f81-61c4-4aed-aff6-34e81a19f6a1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:07.429482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a91005-0d4b-4752-9339-aaa5cda7af88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:07.430493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a91005-0d4b-4752-9339-aaa5cda7af88 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:07.431014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a91005-0d4b-4752-9339-aaa5cda7af88 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:07.431291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a91005-0d4b-4752-9339-aaa5cda7af88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:07.443405 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a91005-0d4b-4752-9339-aaa5cda7af88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:07.444910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a91005-0d4b-4752-9339-aaa5cda7af88 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c0a91005-0d4b-4752-9339-aaa5cda7af88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:07.466024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:07.467231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:07.468178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:07.468178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:07.468178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:07.468178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:07.468178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 613/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:21:07.473571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bef30-2b9c-4e3c-ac0b-706df54d3006 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:07.541983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:07.588031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bef30-2b9c-4e3c-ac0b-706df54d3006 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:07.631467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37b30e-8f93-4ab8-8de3-9722848cf99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:07.632163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37b30e-8f93-4ab8-8de3-9722848cf99f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:07.632442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37b30e-8f93-4ab8-8de3-9722848cf99f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:07.632717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37b30e-8f93-4ab8-8de3-9722848cf99f None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:07.633481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37b30e-8f93-4ab8-8de3-9722848cf99f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:07.633775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37b30e-8f93-4ab8-8de3-9722848cf99f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:07.635158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37b30e-8f93-4ab8-8de3-9722848cf99f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:07.651701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 603/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:07.657397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a91005-0d4b-4752-9339-aaa5cda7af88 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:07.741381 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:07.774627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a91005-0d4b-4752-9339-aaa5cda7af88 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:07.816055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f572aa2-be1c-4582-bcba-f36f6c3ab40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:07.817032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f572aa2-be1c-4582-bcba-f36f6c3ab40e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:07.817409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f572aa2-be1c-4582-bcba-f36f6c3ab40e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:07.817793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f572aa2-be1c-4582-bcba-f36f6c3ab40e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:07.828634 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f572aa2-be1c-4582-bcba-f36f6c3ab40e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:07.830226 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f572aa2-be1c-4582-bcba-f36f6c3ab40e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3f572aa2-be1c-4582-bcba-f36f6c3ab40e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:21:07.844476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:07.852140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:07.853291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:21:07.853291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:21:07.853291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:21:07.853291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:21:07.853291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:21:07.853291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:21:07.853291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:07.853291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:07.853291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 614/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:21:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:21:07.853923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37b30e-8f93-4ab8-8de3-9722848cf99f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:07.963125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37b30e-8f93-4ab8-8de3-9722848cf99f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:07.989033 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:08.003741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a1cb-9fef-4976-86cc-a37975456729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:08.004670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a1cb-9fef-4976-86cc-a37975456729 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:08.005349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a1cb-9fef-4976-86cc-a37975456729 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:08.005801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a1cb-9fef-4976-86cc-a37975456729 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:08.006868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a1cb-9fef-4976-86cc-a37975456729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:08.007433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a1cb-9fef-4976-86cc-a37975456729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:08.009213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a1cb-9fef-4976-86cc-a37975456729 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:08.022444 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 604/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:21:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:08.029526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f572aa2-be1c-4582-bcba-f36f6c3ab40e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:08.140097 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f572aa2-be1c-4582-bcba-f36f6c3ab40e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:08.171528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:08.184997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b3ab2-bdec-4c59-8c43-e655a1b940b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:08.184997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b3ab2-bdec-4c59-8c43-e655a1b940b6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:08.184997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b3ab2-bdec-4c59-8c43-e655a1b940b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:08.184997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b3ab2-bdec-4c59-8c43-e655a1b940b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:08.185456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b3ab2-bdec-4c59-8c43-e655a1b940b6 None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=e0df36a267464042908bbd8eebc7c40c) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:08.185456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b3ab2-bdec-4c59-8c43-e655a1b940b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:08.186863 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b3ab2-bdec-4c59-8c43-e655a1b940b6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:08.193663 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 615/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:21:08 2022] GET /identity/v3/role_assignments?user.id=e0df36a267464042908bbd8eebc7c40c&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:10.315577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742144ff-5756-4523-95be-e531b215fd8b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:10.316396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742144ff-5756-4523-95be-e531b215fd8b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:10.316396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742144ff-5756-4523-95be-e531b215fd8b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:10.317795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 605/1220] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:21:10.323624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9c75-2c89-495c-bf5e-cfaccb1083f0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:10.324103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9c75-2c89-495c-bf5e-cfaccb1083f0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:10.324200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9c75-2c89-495c-bf5e-cfaccb1083f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:10.347987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-05be9c75-2c89-495c-bf5e-cfaccb1083f0 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:21:10.349253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-05be9c75-2c89-495c-bf5e-cfaccb1083f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:21:10.425619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 616/1221] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:21:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:21:10.450294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742144ff-5756-4523-95be-e531b215fd8b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:10.561717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742144ff-5756-4523-95be-e531b215fd8b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:10.598700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb54827-61e1-4cbc-a4dc-9b295c2b7f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:10.599429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb54827-61e1-4cbc-a4dc-9b295c2b7f05 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:10.599708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb54827-61e1-4cbc-a4dc-9b295c2b7f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:10.599977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb54827-61e1-4cbc-a4dc-9b295c2b7f05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:10.610361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb54827-61e1-4cbc-a4dc-9b295c2b7f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ccb54827-61e1-4cbc-a4dc-9b295c2b7f05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:21:10.618095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:10.619070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:10.620002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 606/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:21:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:21:10.626116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9c75-2c89-495c-bf5e-cfaccb1083f0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:10.729913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9c75-2c89-495c-bf5e-cfaccb1083f0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:10.756484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:10.768466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7955c1-0ef8-4cab-806d-412c5c3e39c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:10.769177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7955c1-0ef8-4cab-806d-412c5c3e39c3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:10.769458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7955c1-0ef8-4cab-806d-412c5c3e39c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:10.769726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7955c1-0ef8-4cab-806d-412c5c3e39c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:10.770490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7955c1-0ef8-4cab-806d-412c5c3e39c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:10.770795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7955c1-0ef8-4cab-806d-412c5c3e39c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:10.772163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7955c1-0ef8-4cab-806d-412c5c3e39c3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:10.780302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 617/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:21:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:21:10.786478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb54827-61e1-4cbc-a4dc-9b295c2b7f05 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:10.832631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:10.889038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb54827-61e1-4cbc-a4dc-9b295c2b7f05 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:10.922819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546e356-bba8-4034-a13d-a813922aedab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:10.923612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e356-bba8-4034-a13d-a813922aedab None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:10.923878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e356-bba8-4034-a13d-a813922aedab None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:10.924161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e356-bba8-4034-a13d-a813922aedab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:10.935762 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546e356-bba8-4034-a13d-a813922aedab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:10.937489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546e356-bba8-4034-a13d-a813922aedab None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2546e356-bba8-4034-a13d-a813922aedab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:10.955085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:10.956229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:10.957549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:10.957549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:10.957549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:10.957549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:10.957549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 607/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:10.962436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7955c1-0ef8-4cab-806d-412c5c3e39c3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:11.069186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7955c1-0ef8-4cab-806d-412c5c3e39c3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:11.107076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b814a-b536-46b0-991e-e16a57fa751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:11.107828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b814a-b536-46b0-991e-e16a57fa751f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:11.108172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b814a-b536-46b0-991e-e16a57fa751f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:11.108481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b814a-b536-46b0-991e-e16a57fa751f None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:11.109383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b814a-b536-46b0-991e-e16a57fa751f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:11.109720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b814a-b536-46b0-991e-e16a57fa751f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:11.111592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b814a-b536-46b0-991e-e16a57fa751f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:11.127706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 618/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:11.134937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546e356-bba8-4034-a13d-a813922aedab None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:11.236480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:11.244375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546e356-bba8-4034-a13d-a813922aedab None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:11.283175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab42e85-11e4-40cd-8696-4618d8a0035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:11.284211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab42e85-11e4-40cd-8696-4618d8a0035b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:11.284537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab42e85-11e4-40cd-8696-4618d8a0035b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:11.284840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab42e85-11e4-40cd-8696-4618d8a0035b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:11.292558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab42e85-11e4-40cd-8696-4618d8a0035b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:11.294098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab42e85-11e4-40cd-8696-4618d8a0035b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-aab42e85-11e4-40cd-8696-4618d8a0035b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:21:11.308968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:11.310095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:11.311288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:11.311288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:11.311288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:21:11.311288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:21:11.311288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:21:11.311288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:21:11.311288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:21:11.311288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:21:11.311288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:11.311288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:11.311288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 608/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:11.318222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b814a-b536-46b0-991e-e16a57fa751f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:11.370622 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:11.431527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b814a-b536-46b0-991e-e16a57fa751f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:11.473378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3718c2-cda1-4d32-9707-ab0ca89417cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:11.474358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3718c2-cda1-4d32-9707-ab0ca89417cd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:11.474670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3718c2-cda1-4d32-9707-ab0ca89417cd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:11.474949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3718c2-cda1-4d32-9707-ab0ca89417cd None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:11.475917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3718c2-cda1-4d32-9707-ab0ca89417cd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:11.476229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3718c2-cda1-4d32-9707-ab0ca89417cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:11.477850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3718c2-cda1-4d32-9707-ab0ca89417cd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:11.501967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 619/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jul 6 20:21:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:11.505143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab42e85-11e4-40cd-8696-4618d8a0035b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:11.627301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab42e85-11e4-40cd-8696-4618d8a0035b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:11.664055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4fb1d-e375-482c-ba99-8b862c306c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:11.664904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fb1d-e375-482c-ba99-8b862c306c42 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:11.665266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fb1d-e375-482c-ba99-8b862c306c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:11.665538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fb1d-e375-482c-ba99-8b862c306c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:11.676626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4fb1d-e375-482c-ba99-8b862c306c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:11.678171 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4fb1d-e375-482c-ba99-8b862c306c42 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-51e4fb1d-e375-482c-ba99-8b862c306c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:11.698018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:11.699290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:11.700343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:11.700343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:11.700343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:11.700343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:11.700343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 609/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:11.705302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3718c2-cda1-4d32-9707-ab0ca89417cd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:11.812749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3718c2-cda1-4d32-9707-ab0ca89417cd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:11.815237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:11.849472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4010d8b-6186-4f08-b57c-be72c51ddbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:11.850096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010d8b-6186-4f08-b57c-be72c51ddbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:11.850325 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010d8b-6186-4f08-b57c-be72c51ddbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:11.850601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010d8b-6186-4f08-b57c-be72c51ddbf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:11.851373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010d8b-6186-4f08-b57c-be72c51ddbf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:11.851669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010d8b-6186-4f08-b57c-be72c51ddbf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:11.853108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010d8b-6186-4f08-b57c-be72c51ddbf5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:11.864707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 620/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:21:11.870685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4fb1d-e375-482c-ba99-8b862c306c42 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:11.880492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:11.976453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4fb1d-e375-482c-ba99-8b862c306c42 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:12.012355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92caeb-6f09-4fd1-adca-dff076943106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:12.013210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92caeb-6f09-4fd1-adca-dff076943106 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:12.013487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92caeb-6f09-4fd1-adca-dff076943106 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:12.013902 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92caeb-6f09-4fd1-adca-dff076943106 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:12.022286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92caeb-6f09-4fd1-adca-dff076943106 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:12.023863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92caeb-6f09-4fd1-adca-dff076943106 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2e92caeb-6f09-4fd1-adca-dff076943106 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:21:12.038562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:12.039653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:12.040767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:21:12.040767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:21:12.040767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:21:12.040767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:21:12.040767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:21:12.040767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:21:12.040767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:12.040767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:12.041327 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 610/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:21:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:12.047695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4010d8b-6186-4f08-b57c-be72c51ddbf5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:12.157374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4010d8b-6186-4f08-b57c-be72c51ddbf5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:12.194530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a1431-9fda-490c-b834-b1cb8769786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:12.195193 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1431-9fda-490c-b834-b1cb8769786d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:12.195520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1431-9fda-490c-b834-b1cb8769786d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:12.195803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1431-9fda-490c-b834-b1cb8769786d None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:12.196850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a1431-9fda-490c-b834-b1cb8769786d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:12.197194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a1431-9fda-490c-b834-b1cb8769786d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:12.199339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a1431-9fda-490c-b834-b1cb8769786d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:12.217868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 621/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:12.219758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92caeb-6f09-4fd1-adca-dff076943106 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:12.295699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:12.333543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92caeb-6f09-4fd1-adca-dff076943106 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:12.369266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795613f-abc4-42e7-8348-b5fe7c2c5861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:12.370176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795613f-abc4-42e7-8348-b5fe7c2c5861 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:12.370437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795613f-abc4-42e7-8348-b5fe7c2c5861 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:12.370708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795613f-abc4-42e7-8348-b5fe7c2c5861 None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/e0df36a267464042908bbd8eebc7c40c/roles/b464352c183141f4a1be0d9764ea4105` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:12.386397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795613f-abc4-42e7-8348-b5fe7c2c5861 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=e0df36a267464042908bbd8eebc7c40c, role_id=b464352c183141f4a1be0d9764ea4105)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:12.387841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795613f-abc4-42e7-8348-b5fe7c2c5861 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:12.401016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 611/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:21:12 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/e0df36a267464042908bbd8eebc7c40c/roles/b464352c183141f4a1be0d9764ea4105 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:21:14.466589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159c262-2944-4056-887d-cb91d7239176 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:14.467134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159c262-2944-4056-887d-cb91d7239176 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:14.467413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159c262-2944-4056-887d-cb91d7239176 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:14.469540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 622/1233] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:21:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:21:14.476278 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daccf2-465f-4b48-84b4-232244083251 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:14.476692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daccf2-465f-4b48-84b4-232244083251 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:14.476827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daccf2-465f-4b48-84b4-232244083251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:14.494992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d4daccf2-465f-4b48-84b4-232244083251 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:21:14.496186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d4daccf2-465f-4b48-84b4-232244083251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:21:14.566481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 612/1234] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:21:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:21:14.589799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159c262-2944-4056-887d-cb91d7239176 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:14.615691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:14.692701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159c262-2944-4056-887d-cb91d7239176 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:14.728477 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c596317-dccc-4de7-9158-d374c61d8e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:14.729276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c596317-dccc-4de7-9158-d374c61d8e3d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:14.729576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c596317-dccc-4de7-9158-d374c61d8e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:14.729808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c596317-dccc-4de7-9158-d374c61d8e3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:14.740930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c596317-dccc-4de7-9158-d374c61d8e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6c596317-dccc-4de7-9158-d374c61d8e3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:21:14.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:14.751099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:14.752148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 623/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Wed Jul 6 20:21:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:21:14.757062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daccf2-465f-4b48-84b4-232244083251 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:14.804176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:14.863577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daccf2-465f-4b48-84b4-232244083251 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:14.899332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c5bf7-66a7-4053-8951-eeaf4531c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:14.900068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5bf7-66a7-4053-8951-eeaf4531c79f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:14.900349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5bf7-66a7-4053-8951-eeaf4531c79f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:14.900620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5bf7-66a7-4053-8951-eeaf4531c79f None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:14.901432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c5bf7-66a7-4053-8951-eeaf4531c79f None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:14.901777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c5bf7-66a7-4053-8951-eeaf4531c79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:14.903297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c5bf7-66a7-4053-8951-eeaf4531c79f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:14.911942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 613/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Wed Jul 6 20:21:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:14.917872 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c596317-dccc-4de7-9158-d374c61d8e3d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:15.007684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:15.027894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c596317-dccc-4de7-9158-d374c61d8e3d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:15.062774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c37a5-9d1f-4749-93eb-9a1642700b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:15.063578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c37a5-9d1f-4749-93eb-9a1642700b85 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:15.063858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c37a5-9d1f-4749-93eb-9a1642700b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:15.064133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c37a5-9d1f-4749-93eb-9a1642700b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:15.075126 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c37a5-9d1f-4749-93eb-9a1642700b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:15.076655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c37a5-9d1f-4749-93eb-9a1642700b85 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-495c37a5-9d1f-4749-93eb-9a1642700b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:15.094009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:15.095010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:15.095926 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:15.095926 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:15.095926 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:15.095926 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:15.100157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 624/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:15.101517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c5bf7-66a7-4053-8951-eeaf4531c79f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:15.210612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c5bf7-66a7-4053-8951-eeaf4531c79f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:15.219913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:15.246482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1958a35-2871-4a6a-be73-5ca7fd7c6d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:15.247168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1958a35-2871-4a6a-be73-5ca7fd7c6d28 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:15.247447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1958a35-2871-4a6a-be73-5ca7fd7c6d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:15.247767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1958a35-2871-4a6a-be73-5ca7fd7c6d28 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:15.248847 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1958a35-2871-4a6a-be73-5ca7fd7c6d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:15.249141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1958a35-2871-4a6a-be73-5ca7fd7c6d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:15.250508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1958a35-2871-4a6a-be73-5ca7fd7c6d28 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:15.263596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 614/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:15.269772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c37a5-9d1f-4749-93eb-9a1642700b85 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:15.380373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c37a5-9d1f-4749-93eb-9a1642700b85 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:15.414719 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e35a1-64de-4e8c-bf10-ab43c523e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:15.415529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e35a1-64de-4e8c-bf10-ab43c523e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:15.415809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e35a1-64de-4e8c-bf10-ab43c523e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:15.416082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e35a1-64de-4e8c-bf10-ab43c523e3e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:15.418908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:15.424769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e35a1-64de-4e8c-bf10-ab43c523e3e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:15.426718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e35a1-64de-4e8c-bf10-ab43c523e3e6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0d4e35a1-64de-4e8c-bf10-ab43c523e3e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:21:15.441653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:15.442770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:15.444055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:15.444055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:15.444055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:21:15.444055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:21:15.444055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:21:15.444055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:21:15.444055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:21:15.444055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:21:15.444055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:15.444055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:15.444055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 625/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:15.449122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1958a35-2871-4a6a-be73-5ca7fd7c6d28 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:15.558038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1958a35-2871-4a6a-be73-5ca7fd7c6d28 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:15.601018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c461c29-4dad-4978-808c-16c32609f667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:15.601018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461c29-4dad-4978-808c-16c32609f667 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:15.601018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461c29-4dad-4978-808c-16c32609f667 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:15.601018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461c29-4dad-4978-808c-16c32609f667 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:15.601504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c461c29-4dad-4978-808c-16c32609f667 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:15.601504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c461c29-4dad-4978-808c-16c32609f667 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:15.602320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c461c29-4dad-4978-808c-16c32609f667 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:15.622325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 615/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jul 6 20:21:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:15.628924 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e35a1-64de-4e8c-bf10-ab43c523e3e6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:15.738022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e35a1-64de-4e8c-bf10-ab43c523e3e6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:15.774065 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24a48f-8b28-4061-bc6d-49acaad6dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:15.774735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24a48f-8b28-4061-bc6d-49acaad6dd5d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:15.775017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24a48f-8b28-4061-bc6d-49acaad6dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:15.775387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24a48f-8b28-4061-bc6d-49acaad6dd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:15.843346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:15.851302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24a48f-8b28-4061-bc6d-49acaad6dd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:15.853262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24a48f-8b28-4061-bc6d-49acaad6dd5d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:15.963988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 626/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:21:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:21:15.969959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c461c29-4dad-4978-808c-16c32609f667 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:16.002225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:16.080744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c461c29-4dad-4978-808c-16c32609f667 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:16.120687 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7c257-1225-45d4-8981-1a2fdcc8480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:16.121792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7c257-1225-45d4-8981-1a2fdcc8480a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:16.122083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7c257-1225-45d4-8981-1a2fdcc8480a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:16.122530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7c257-1225-45d4-8981-1a2fdcc8480a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:16.135218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7c257-1225-45d4-8981-1a2fdcc8480a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:16.136661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7c257-1225-45d4-8981-1a2fdcc8480a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-29c7c257-1225-45d4-8981-1a2fdcc8480a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:16.155266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:16.156296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:16.157784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:16.157784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:16.157784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:16.157784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:16.157784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 616/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:16.163204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24a48f-8b28-4061-bc6d-49acaad6dd5d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:16.277763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:16.285486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24a48f-8b28-4061-bc6d-49acaad6dd5d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:16.322773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22e346-ed89-49d7-832b-5771e0c1b99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:16.324169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22e346-ed89-49d7-832b-5771e0c1b99a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:16.324169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22e346-ed89-49d7-832b-5771e0c1b99a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:16.324169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22e346-ed89-49d7-832b-5771e0c1b99a None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:16.324702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22e346-ed89-49d7-832b-5771e0c1b99a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:16.325114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22e346-ed89-49d7-832b-5771e0c1b99a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:16.326508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22e346-ed89-49d7-832b-5771e0c1b99a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:16.339490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 627/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:16.345378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7c257-1225-45d4-8981-1a2fdcc8480a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:16.437783 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:16.464571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7c257-1225-45d4-8981-1a2fdcc8480a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:16.502957 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077f99c-bc47-4003-888f-36c071c71771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:16.504096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f99c-bc47-4003-888f-36c071c71771 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:16.504374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f99c-bc47-4003-888f-36c071c71771 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:16.504642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f99c-bc47-4003-888f-36c071c71771 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:16.514721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077f99c-bc47-4003-888f-36c071c71771 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:16.516277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077f99c-bc47-4003-888f-36c071c71771 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4077f99c-bc47-4003-888f-36c071c71771 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:21:16.531166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:16.532131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:16.533484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:21:16.533484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:21:16.533484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:21:16.533484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:21:16.533484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:21:16.533484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:21:16.533484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:16.533484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:16.533484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 617/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:21:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:16.538587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22e346-ed89-49d7-832b-5771e0c1b99a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:16.652574 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22e346-ed89-49d7-832b-5771e0c1b99a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:16.687158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367cd73-66ba-41d2-a739-b6cbd0ec010e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:16.687912 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367cd73-66ba-41d2-a739-b6cbd0ec010e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:16.688199 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367cd73-66ba-41d2-a739-b6cbd0ec010e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:16.688533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367cd73-66ba-41d2-a739-b6cbd0ec010e None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:16.689458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367cd73-66ba-41d2-a739-b6cbd0ec010e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:16.689786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367cd73-66ba-41d2-a739-b6cbd0ec010e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:16.691326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367cd73-66ba-41d2-a739-b6cbd0ec010e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:16.703832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 628/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:21:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:21:16.711261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077f99c-bc47-4003-888f-36c071c71771 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:16.822183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077f99c-bc47-4003-888f-36c071c71771 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:16.855710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89f70-7390-4e0c-b454-90988075adea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:16.856368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89f70-7390-4e0c-b454-90988075adea None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:16.856644 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89f70-7390-4e0c-b454-90988075adea None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:16.856986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89f70-7390-4e0c-b454-90988075adea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:16.857810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89f70-7390-4e0c-b454-90988075adea None admin] RBAC: Adding query filter params (role.id=b464352c183141f4a1be0d9764ea4105, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=e0df36a267464042908bbd8eebc7c40c) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:16.858116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89f70-7390-4e0c-b454-90988075adea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:16.859560 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89f70-7390-4e0c-b454-90988075adea None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:16.865538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 618/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:21:16 2022] GET /identity/v3/role_assignments?user.id=e0df36a267464042908bbd8eebc7c40c&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=b464352c183141f4a1be0d9764ea4105 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:18.961105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9762-7890-4630-8eaa-aabf26c78154 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:18.961105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9762-7890-4630-8eaa-aabf26c78154 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:18.961105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9762-7890-4630-8eaa-aabf26c78154 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:18.961105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 629/1247] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:21:18.966927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77e417-827d-457f-99db-f1d1269c59c8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:18.967399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77e417-827d-457f-99db-f1d1269c59c8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:18.967562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77e417-827d-457f-99db-f1d1269c59c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:18.974375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:18.989255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9a77e417-827d-457f-99db-f1d1269c59c8 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:21:18.990587 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9a77e417-827d-457f-99db-f1d1269c59c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:21:19.073905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 619/1248] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:21:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:21:19.099658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9762-7890-4630-8eaa-aabf26c78154 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:19.119703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:19.224479 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9762-7890-4630-8eaa-aabf26c78154 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:19.262338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad38cc1-d9fd-41bd-9fe1-edd39ce8dd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:19.263314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad38cc1-d9fd-41bd-9fe1-edd39ce8dd34 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:19.263590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad38cc1-d9fd-41bd-9fe1-edd39ce8dd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:19.263843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad38cc1-d9fd-41bd-9fe1-edd39ce8dd34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:19.275506 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad38cc1-d9fd-41bd-9fe1-edd39ce8dd34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4ad38cc1-d9fd-41bd-9fe1-edd39ce8dd34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:21:19.283314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:19.285181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:19.286777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 630/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:21:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:19.294113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77e417-827d-457f-99db-f1d1269c59c8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:19.411870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77e417-827d-457f-99db-f1d1269c59c8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:19.446370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:19.453038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ea35d-53a5-492d-90da-d3d4fcc8d668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:19.453689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ea35d-53a5-492d-90da-d3d4fcc8d668 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:19.453965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ea35d-53a5-492d-90da-d3d4fcc8d668 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:19.454234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ea35d-53a5-492d-90da-d3d4fcc8d668 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:19.455363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ea35d-53a5-492d-90da-d3d4fcc8d668 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:19.455677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ea35d-53a5-492d-90da-d3d4fcc8d668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:19.457124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ea35d-53a5-492d-90da-d3d4fcc8d668 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:19.466299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 620/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:21:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:19.472596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad38cc1-d9fd-41bd-9fe1-edd39ce8dd34 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:19.563760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:19.599840 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad38cc1-d9fd-41bd-9fe1-edd39ce8dd34 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:19.636659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfd906-e5ab-47ba-87cc-22edab672d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:19.637490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfd906-e5ab-47ba-87cc-22edab672d6b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:19.637791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfd906-e5ab-47ba-87cc-22edab672d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:19.638203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfd906-e5ab-47ba-87cc-22edab672d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:19.650803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfd906-e5ab-47ba-87cc-22edab672d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:19.652601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfd906-e5ab-47ba-87cc-22edab672d6b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f3cfd906-e5ab-47ba-87cc-22edab672d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:19.671504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:19.672567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:19.678082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:19.678082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:19.678082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:19.678082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:19.678082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 631/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:19.679475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ea35d-53a5-492d-90da-d3d4fcc8d668 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:19.796004 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ea35d-53a5-492d-90da-d3d4fcc8d668 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:19.832136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6cb62-fa02-4a6a-919a-eacac940e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:19.832820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cb62-fa02-4a6a-919a-eacac940e922 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:19.833135 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cb62-fa02-4a6a-919a-eacac940e922 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:19.833413 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cb62-fa02-4a6a-919a-eacac940e922 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:19.834150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6cb62-fa02-4a6a-919a-eacac940e922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:19.834457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6cb62-fa02-4a6a-919a-eacac940e922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:19.835888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6cb62-fa02-4a6a-919a-eacac940e922 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:19.849669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 621/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:19.855997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfd906-e5ab-47ba-87cc-22edab672d6b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:19.970761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfd906-e5ab-47ba-87cc-22edab672d6b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:20.000352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:20.010245 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd872d84-c202-44df-b58d-5250326d1c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:20.011208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872d84-c202-44df-b58d-5250326d1c6e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:20.011540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872d84-c202-44df-b58d-5250326d1c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:20.011785 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872d84-c202-44df-b58d-5250326d1c6e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:20.020510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd872d84-c202-44df-b58d-5250326d1c6e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:20.022260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd872d84-c202-44df-b58d-5250326d1c6e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bd872d84-c202-44df-b58d-5250326d1c6e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:21:20.040302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:20.041580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:20.042726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:20.042726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:20.042726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:21:20.042726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:21:20.042726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:21:20.042726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:21:20.042726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:21:20.042726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:21:20.042726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:20.042726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:20.042726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 632/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:20.048323 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6cb62-fa02-4a6a-919a-eacac940e922 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:20.118133 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:20.171834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6cb62-fa02-4a6a-919a-eacac940e922 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:20.210474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f8041-084c-43f7-bcc4-16e24609a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:20.211435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f8041-084c-43f7-bcc4-16e24609a389 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:20.211841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f8041-084c-43f7-bcc4-16e24609a389 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:20.212133 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f8041-084c-43f7-bcc4-16e24609a389 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:20.213054 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f8041-084c-43f7-bcc4-16e24609a389 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:20.213431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f8041-084c-43f7-bcc4-16e24609a389 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:20.215386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f8041-084c-43f7-bcc4-16e24609a389 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:20.238209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 622/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jul 6 20:21:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:20.244919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd872d84-c202-44df-b58d-5250326d1c6e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:20.361690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd872d84-c202-44df-b58d-5250326d1c6e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:20.398605 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621c9f9-bd7a-443c-9dc8-6ce55f0aa8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:20.399350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621c9f9-bd7a-443c-9dc8-6ce55f0aa8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:20.399653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621c9f9-bd7a-443c-9dc8-6ce55f0aa8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:20.399922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621c9f9-bd7a-443c-9dc8-6ce55f0aa8e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:20.459368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:20.472572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621c9f9-bd7a-443c-9dc8-6ce55f0aa8e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:20.474075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621c9f9-bd7a-443c-9dc8-6ce55f0aa8e5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:20.601342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 633/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:21:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:21:20.607239 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f8041-084c-43f7-bcc4-16e24609a389 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:20.724272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f8041-084c-43f7-bcc4-16e24609a389 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:20.738562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:20.760978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67566b9-344d-474a-bc5b-ae200d4cc720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:20.761797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67566b9-344d-474a-bc5b-ae200d4cc720 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:20.762076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67566b9-344d-474a-bc5b-ae200d4cc720 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:20.762341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67566b9-344d-474a-bc5b-ae200d4cc720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:20.772596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67566b9-344d-474a-bc5b-ae200d4cc720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:20.774076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67566b9-344d-474a-bc5b-ae200d4cc720 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f67566b9-344d-474a-bc5b-ae200d4cc720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:20.794735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:20.795855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:20.796981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:20.796981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:20.796981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:20.796981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:20.796981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 623/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:20.802163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621c9f9-bd7a-443c-9dc8-6ce55f0aa8e5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:20.909944 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:20.925919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621c9f9-bd7a-443c-9dc8-6ce55f0aa8e5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:20.971592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b034ae-46cd-4660-8edd-f3829c9fc7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:20.972372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b034ae-46cd-4660-8edd-f3829c9fc7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:20.972555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b034ae-46cd-4660-8edd-f3829c9fc7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:20.972804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b034ae-46cd-4660-8edd-f3829c9fc7a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:20.973570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b034ae-46cd-4660-8edd-f3829c9fc7a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:20.973878 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b034ae-46cd-4660-8edd-f3829c9fc7a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:20.975261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b034ae-46cd-4660-8edd-f3829c9fc7a7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:20.988594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 634/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:20.995697 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67566b9-344d-474a-bc5b-ae200d4cc720 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:21.099271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67566b9-344d-474a-bc5b-ae200d4cc720 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:21.134645 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544c597-a9c1-4b8c-b3ce-31fb2496bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:21.135449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c597-a9c1-4b8c-b3ce-31fb2496bf2c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:21.135731 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c597-a9c1-4b8c-b3ce-31fb2496bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:21.136004 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c597-a9c1-4b8c-b3ce-31fb2496bf2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:21.142881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544c597-a9c1-4b8c-b3ce-31fb2496bf2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:21.144405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544c597-a9c1-4b8c-b3ce-31fb2496bf2c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4544c597-a9c1-4b8c-b3ce-31fb2496bf2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:21:21.159009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:21.160009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:21.160898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:21:21.160898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:21:21.160898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:21:21.160898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:21:21.160898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:21:21.160898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:21:21.160898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:21.160898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:21.160898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 624/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:21:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:21.166300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b034ae-46cd-4660-8edd-f3829c9fc7a7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:21.285175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b034ae-46cd-4660-8edd-f3829c9fc7a7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:21.322409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ee24f-d0b4-43e4-bbc1-9e2330041546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:21.323070 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ee24f-d0b4-43e4-bbc1-9e2330041546 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:21.323339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ee24f-d0b4-43e4-bbc1-9e2330041546 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:21.323607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ee24f-d0b4-43e4-bbc1-9e2330041546 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:21.324392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ee24f-d0b4-43e4-bbc1-9e2330041546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:21.324695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ee24f-d0b4-43e4-bbc1-9e2330041546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:21.326236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ee24f-d0b4-43e4-bbc1-9e2330041546 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:21.339386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 635/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:21:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:21.345507 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544c597-a9c1-4b8c-b3ce-31fb2496bf2c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:21.373231 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:21.452479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544c597-a9c1-4b8c-b3ce-31fb2496bf2c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:21.486778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c43cb7-d395-428d-a6ba-566747928f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:21.487438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c43cb7-d395-428d-a6ba-566747928f11 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:21.487717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c43cb7-d395-428d-a6ba-566747928f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:21.487987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c43cb7-d395-428d-a6ba-566747928f11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:21.488813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c43cb7-d395-428d-a6ba-566747928f11 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=e0df36a267464042908bbd8eebc7c40c) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:21.489150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c43cb7-d395-428d-a6ba-566747928f11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:21.490577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c43cb7-d395-428d-a6ba-566747928f11 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:21.496337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 625/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:21:21 2022] GET /identity/v3/role_assignments?user.id=e0df36a267464042908bbd8eebc7c40c&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:23.493452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d006c6-72c4-4c5e-bcaa-99a36a0c7b13 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:23.494302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d006c6-72c4-4c5e-bcaa-99a36a0c7b13 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:23.494302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d006c6-72c4-4c5e-bcaa-99a36a0c7b13 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:23.496500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 636/1261] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:21:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:21:23.503212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d308-f419-4abc-9414-c2124ca50501 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:23.503920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d308-f419-4abc-9414-c2124ca50501 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:23.504063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d308-f419-4abc-9414-c2124ca50501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:23.525763 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-efe1d308-f419-4abc-9414-c2124ca50501 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:21:23.526945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-efe1d308-f419-4abc-9414-c2124ca50501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:21:23.607508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 626/1262] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:21:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:21:23.630556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d006c6-72c4-4c5e-bcaa-99a36a0c7b13 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:23.642049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:23.736194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d006c6-72c4-4c5e-bcaa-99a36a0c7b13 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:23.771877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfbb82-05a1-4dcb-b427-d6d940ff1581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:23.772563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfbb82-05a1-4dcb-b427-d6d940ff1581 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:23.772839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfbb82-05a1-4dcb-b427-d6d940ff1581 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:23.773137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfbb82-05a1-4dcb-b427-d6d940ff1581 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:23.784197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfbb82-05a1-4dcb-b427-d6d940ff1581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-80cfbb82-05a1-4dcb-b427-d6d940ff1581 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:21:23.791630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:23.792678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:23.793594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 637/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:21:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:23.801790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1d308-f419-4abc-9414-c2124ca50501 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:23.822305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:23.908768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1d308-f419-4abc-9414-c2124ca50501 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:23.945097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad012a0-a6fa-4f35-9742-7acc3632c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:23.945760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad012a0-a6fa-4f35-9742-7acc3632c9cb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:23.946041 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad012a0-a6fa-4f35-9742-7acc3632c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:23.946317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad012a0-a6fa-4f35-9742-7acc3632c9cb None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:23.947071 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad012a0-a6fa-4f35-9742-7acc3632c9cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:23.947377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad012a0-a6fa-4f35-9742-7acc3632c9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:23.948756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad012a0-a6fa-4f35-9742-7acc3632c9cb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:23.956985 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 627/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:21:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:23.963052 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfbb82-05a1-4dcb-b427-d6d940ff1581 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:24.035247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:24.070000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfbb82-05a1-4dcb-b427-d6d940ff1581 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:24.105012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2eb01-481e-46eb-95c0-cced34941207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:24.105808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2eb01-481e-46eb-95c0-cced34941207 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:24.106089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2eb01-481e-46eb-95c0-cced34941207 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:24.106414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2eb01-481e-46eb-95c0-cced34941207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:24.117315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2eb01-481e-46eb-95c0-cced34941207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:24.118759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2eb01-481e-46eb-95c0-cced34941207 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b8f2eb01-481e-46eb-95c0-cced34941207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:24.136198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:24.137233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:24.138509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:24.138509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:24.138509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:24.138509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:24.138509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 638/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:24.143163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad012a0-a6fa-4f35-9742-7acc3632c9cb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:24.243730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:24.270958 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad012a0-a6fa-4f35-9742-7acc3632c9cb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:24.304459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe38c-2221-460c-9ed0-4a4a497b371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:24.305093 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe38c-2221-460c-9ed0-4a4a497b371d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:24.305376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe38c-2221-460c-9ed0-4a4a497b371d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:24.305652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe38c-2221-460c-9ed0-4a4a497b371d None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:24.306381 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fe38c-2221-460c-9ed0-4a4a497b371d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:24.306690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fe38c-2221-460c-9ed0-4a4a497b371d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:24.308066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fe38c-2221-460c-9ed0-4a4a497b371d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:24.319460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 628/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:24.325725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2eb01-481e-46eb-95c0-cced34941207 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:24.431972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2eb01-481e-46eb-95c0-cced34941207 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:24.451905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:24.467848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d17ba5-3acf-4632-a98f-17c924cb2f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:24.468636 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d17ba5-3acf-4632-a98f-17c924cb2f0b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:24.468925 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d17ba5-3acf-4632-a98f-17c924cb2f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:24.469231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d17ba5-3acf-4632-a98f-17c924cb2f0b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:24.476824 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d17ba5-3acf-4632-a98f-17c924cb2f0b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:24.478292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d17ba5-3acf-4632-a98f-17c924cb2f0b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-43d17ba5-3acf-4632-a98f-17c924cb2f0b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:21:24.492509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:24.494046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:24.495160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:24.495160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:24.495160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:21:24.495160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:21:24.495160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:21:24.495160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:21:24.495160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:21:24.495160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:21:24.495160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:24.495160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:24.495160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 639/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:24.500112 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe38c-2221-460c-9ed0-4a4a497b371d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:24.614712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe38c-2221-460c-9ed0-4a4a497b371d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:24.649243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e4494-58c2-4269-b961-fbdb9ce80a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:24.649905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e4494-58c2-4269-b961-fbdb9ce80a3c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:24.650187 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e4494-58c2-4269-b961-fbdb9ce80a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:24.650459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e4494-58c2-4269-b961-fbdb9ce80a3c None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:24.651315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e4494-58c2-4269-b961-fbdb9ce80a3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:24.651624 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e4494-58c2-4269-b961-fbdb9ce80a3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:24.653069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e4494-58c2-4269-b961-fbdb9ce80a3c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:24.661814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:24.670677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 629/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jul 6 20:21:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:24.676649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d17ba5-3acf-4632-a98f-17c924cb2f0b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:24.782724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d17ba5-3acf-4632-a98f-17c924cb2f0b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:24.818260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df549f-5f22-4a05-b444-a8e120d81231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:24.819045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df549f-5f22-4a05-b444-a8e120d81231 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:24.819318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df549f-5f22-4a05-b444-a8e120d81231 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:24.819580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df549f-5f22-4a05-b444-a8e120d81231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:24.831409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df549f-5f22-4a05-b444-a8e120d81231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:24.832836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df549f-5f22-4a05-b444-a8e120d81231 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-62df549f-5f22-4a05-b444-a8e120d81231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:24.850710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:24.851735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:24.852700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:24.852700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:24.852700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:24.852700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:24.856643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 640/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:24.857718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e4494-58c2-4269-b961-fbdb9ce80a3c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:24.962460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e4494-58c2-4269-b961-fbdb9ce80a3c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:24.999442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411c555-fb7a-4195-9060-5a187cf85094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:25.000079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411c555-fb7a-4195-9060-5a187cf85094 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:25.000352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411c555-fb7a-4195-9060-5a187cf85094 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:25.000614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411c555-fb7a-4195-9060-5a187cf85094 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:25.001364 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411c555-fb7a-4195-9060-5a187cf85094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:25.001663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411c555-fb7a-4195-9060-5a187cf85094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:25.003013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411c555-fb7a-4195-9060-5a187cf85094 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:25.014151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 630/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:21:25.019928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df549f-5f22-4a05-b444-a8e120d81231 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:25.056032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:25.127946 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df549f-5f22-4a05-b444-a8e120d81231 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:25.163890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724c224-f2a9-4a3b-893d-7e794e295972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:25.164667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724c224-f2a9-4a3b-893d-7e794e295972 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:25.164945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724c224-f2a9-4a3b-893d-7e794e295972 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:25.165250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724c224-f2a9-4a3b-893d-7e794e295972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:25.172485 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724c224-f2a9-4a3b-893d-7e794e295972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:25.173952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724c224-f2a9-4a3b-893d-7e794e295972 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9724c224-f2a9-4a3b-893d-7e794e295972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:21:25.188461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:25.189494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:25.193961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:21:25.193961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:21:25.193961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:21:25.193961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:21:25.193961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:21:25.193961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:21:25.193961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:25.193961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:25.193961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 641/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:21:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:25.196107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411c555-fb7a-4195-9060-5a187cf85094 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:25.262485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:25.305365 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411c555-fb7a-4195-9060-5a187cf85094 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:25.337565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e44662-3da5-4a04-9328-6e41df106203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:25.338209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e44662-3da5-4a04-9328-6e41df106203 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:25.338490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e44662-3da5-4a04-9328-6e41df106203 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:25.338769 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e44662-3da5-4a04-9328-6e41df106203 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:25.339555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e44662-3da5-4a04-9328-6e41df106203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:25.339860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e44662-3da5-4a04-9328-6e41df106203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:25.341433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e44662-3da5-4a04-9328-6e41df106203 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:25.353516 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 631/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:21:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:25.359660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724c224-f2a9-4a3b-893d-7e794e295972 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:25.466476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:25.478042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724c224-f2a9-4a3b-893d-7e794e295972 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:25.516154 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc420f79-6203-4d84-88cf-0864c94423ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:25.516992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc420f79-6203-4d84-88cf-0864c94423ae None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:25.517268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc420f79-6203-4d84-88cf-0864c94423ae None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:25.517542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc420f79-6203-4d84-88cf-0864c94423ae None admin] PATH_INFO: `/v3/projects/fa631f63e06643bd98323366357c3597/users/e0df36a267464042908bbd8eebc7c40c/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:25.519588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc420f79-6203-4d84-88cf-0864c94423ae None admin] RBAC: Authorizing `identity:create_grant(project_id=fa631f63e06643bd98323366357c3597, user_id=e0df36a267464042908bbd8eebc7c40c, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:25.521015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc420f79-6203-4d84-88cf-0864c94423ae None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:25.542214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 642/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Wed Jul 6 20:21:25 2022] PUT /identity/v3/projects/fa631f63e06643bd98323366357c3597/users/e0df36a267464042908bbd8eebc7c40c/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:21:27.512022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed1ec-20a3-4433-8fb8-c412114c291f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:27.512608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed1ec-20a3-4433-8fb8-c412114c291f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:27.512608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed1ec-20a3-4433-8fb8-c412114c291f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:27.513983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 632/1274] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:21:27.520196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916ba3-eb18-4ccc-aaaa-64f0201d2006 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:27.520876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916ba3-eb18-4ccc-aaaa-64f0201d2006 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:27.521088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916ba3-eb18-4ccc-aaaa-64f0201d2006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:27.539936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f3916ba3-eb18-4ccc-aaaa-64f0201d2006 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:21:27.541128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f3916ba3-eb18-4ccc-aaaa-64f0201d2006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:21:27.624609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 643/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:21:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:21:27.648447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ed1ec-20a3-4433-8fb8-c412114c291f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:27.759893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ed1ec-20a3-4433-8fb8-c412114c291f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:27.777751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:27.795979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c1307-dfce-4723-ac19-b80edd292618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:27.796758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c1307-dfce-4723-ac19-b80edd292618 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:27.797067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c1307-dfce-4723-ac19-b80edd292618 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:27.797340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c1307-dfce-4723-ac19-b80edd292618 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:27.808673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c1307-dfce-4723-ac19-b80edd292618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-721c1307-dfce-4723-ac19-b80edd292618 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:21:27.816423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:27.817521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:27.818488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 633/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Wed Jul 6 20:21:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:27.823752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3916ba3-eb18-4ccc-aaaa-64f0201d2006 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:27.908907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:27.930766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3916ba3-eb18-4ccc-aaaa-64f0201d2006 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:27.967743 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f515ca-29b0-4022-bdec-b1bd238037c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:27.968430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f515ca-29b0-4022-bdec-b1bd238037c6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:27.968686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f515ca-29b0-4022-bdec-b1bd238037c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:27.968938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f515ca-29b0-4022-bdec-b1bd238037c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:27.969723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f515ca-29b0-4022-bdec-b1bd238037c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:27.970032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f515ca-29b0-4022-bdec-b1bd238037c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:27.971393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f515ca-29b0-4022-bdec-b1bd238037c6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:27.979458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 644/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Wed Jul 6 20:21:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:27.988826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c1307-dfce-4723-ac19-b80edd292618 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:28.106898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c1307-dfce-4723-ac19-b80edd292618 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:28.143089 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b942bdf-f0c8-4fd9-afcb-a4409914ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:28.144255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b942bdf-f0c8-4fd9-afcb-a4409914ce8a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:28.144659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b942bdf-f0c8-4fd9-afcb-a4409914ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:28.145105 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b942bdf-f0c8-4fd9-afcb-a4409914ce8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:28.159478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b942bdf-f0c8-4fd9-afcb-a4409914ce8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:28.160917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b942bdf-f0c8-4fd9-afcb-a4409914ce8a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3b942bdf-f0c8-4fd9-afcb-a4409914ce8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:28.178403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:28.179429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:28.180469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:28.180469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:28.180469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:28.180469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:28.180469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 634/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:28.185488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f515ca-29b0-4022-bdec-b1bd238037c6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:28.296659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f515ca-29b0-4022-bdec-b1bd238037c6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:28.331439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c087066-5afb-464c-8bda-76ddab8b1f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:28.332088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c087066-5afb-464c-8bda-76ddab8b1f19 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:28.332368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c087066-5afb-464c-8bda-76ddab8b1f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:28.332635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c087066-5afb-464c-8bda-76ddab8b1f19 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:28.333387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c087066-5afb-464c-8bda-76ddab8b1f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:28.333688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c087066-5afb-464c-8bda-76ddab8b1f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:28.335054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c087066-5afb-464c-8bda-76ddab8b1f19 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:28.346931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 645/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:28.353624 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b942bdf-f0c8-4fd9-afcb-a4409914ce8a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:28.393824 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:28.469202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b942bdf-f0c8-4fd9-afcb-a4409914ce8a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:28.505659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bceec7-28a1-4de5-93f9-4912b9b3efef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:28.506463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bceec7-28a1-4de5-93f9-4912b9b3efef None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:28.506742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bceec7-28a1-4de5-93f9-4912b9b3efef None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:28.507018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bceec7-28a1-4de5-93f9-4912b9b3efef None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:28.516061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bceec7-28a1-4de5-93f9-4912b9b3efef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:28.517547 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bceec7-28a1-4de5-93f9-4912b9b3efef None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f4bceec7-28a1-4de5-93f9-4912b9b3efef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:21:28.532280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:28.533355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:28.534469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:28.534469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:28.534469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:21:28.534469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:21:28.534469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:21:28.534469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:21:28.534469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:21:28.534469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:21:28.534469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:21:28.534469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:28.537107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 635/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:28.539454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c087066-5afb-464c-8bda-76ddab8b1f19 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:28.544651 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:28.655443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c087066-5afb-464c-8bda-76ddab8b1f19 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:28.688682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a9337-5b59-4b0f-a39d-aff4b5945db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:28.689383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a9337-5b59-4b0f-a39d-aff4b5945db3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:28.689663 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a9337-5b59-4b0f-a39d-aff4b5945db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:28.689934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a9337-5b59-4b0f-a39d-aff4b5945db3 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:28.690779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a9337-5b59-4b0f-a39d-aff4b5945db3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:28.691084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a9337-5b59-4b0f-a39d-aff4b5945db3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:28.692511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a9337-5b59-4b0f-a39d-aff4b5945db3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:28.709561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 646/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Wed Jul 6 20:21:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:28.715447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bceec7-28a1-4de5-93f9-4912b9b3efef None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:28.807209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:28.816922 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bceec7-28a1-4de5-93f9-4912b9b3efef None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:28.850118 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f1587-1be3-49bb-ae20-9601114d2601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:28.850758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f1587-1be3-49bb-ae20-9601114d2601 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:28.851046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f1587-1be3-49bb-ae20-9601114d2601 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:28.851322 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f1587-1be3-49bb-ae20-9601114d2601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:28.925866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f1587-1be3-49bb-ae20-9601114d2601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:28.927237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f1587-1be3-49bb-ae20-9601114d2601 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:29.021228 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:29.036537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 636/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Wed Jul 6 20:21:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:21:29.043228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a9337-5b59-4b0f-a39d-aff4b5945db3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:29.126756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:29.176873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a9337-5b59-4b0f-a39d-aff4b5945db3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:29.211193 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86426059-8617-40f8-b09f-8c30733f37bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:29.211973 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86426059-8617-40f8-b09f-8c30733f37bf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:29.212253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86426059-8617-40f8-b09f-8c30733f37bf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:29.212526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86426059-8617-40f8-b09f-8c30733f37bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:29.222944 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86426059-8617-40f8-b09f-8c30733f37bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:29.224388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86426059-8617-40f8-b09f-8c30733f37bf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-86426059-8617-40f8-b09f-8c30733f37bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:21:29.245682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:29.247952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:29.249034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:21:29.249034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:21:29.249034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:21:29.249034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:29.249034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 647/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:29.254020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f1587-1be3-49bb-ae20-9601114d2601 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:29.351433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f1587-1be3-49bb-ae20-9601114d2601 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:29.386897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfab5b-1911-44a8-8c99-ea35651cc400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:29.387577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfab5b-1911-44a8-8c99-ea35651cc400 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:29.387855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfab5b-1911-44a8-8c99-ea35651cc400 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:29.388127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfab5b-1911-44a8-8c99-ea35651cc400 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:29.388844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfab5b-1911-44a8-8c99-ea35651cc400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:29.389175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfab5b-1911-44a8-8c99-ea35651cc400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:29.390528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfab5b-1911-44a8-8c99-ea35651cc400 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:29.402844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 637/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Wed Jul 6 20:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:29.411820 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86426059-8617-40f8-b09f-8c30733f37bf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:29.514319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86426059-8617-40f8-b09f-8c30733f37bf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:29.528009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:29.559275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62e28d-65c6-417e-a253-ce23c6290753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:29.560206 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62e28d-65c6-417e-a253-ce23c6290753 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:29.560521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62e28d-65c6-417e-a253-ce23c6290753 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:29.560844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62e28d-65c6-417e-a253-ce23c6290753 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:29.571911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62e28d-65c6-417e-a253-ce23c6290753 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:29.574446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62e28d-65c6-417e-a253-ce23c6290753 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7f62e28d-65c6-417e-a253-ce23c6290753 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:21:29.589194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:29.590408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:29.591412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:21:29.591412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:21:29.591412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:21:29.591412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:21:29.591412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:21:29.591412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:21:29.591412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:21:29.591412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 06 20:21:29.591412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 648/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Wed Jul 6 20:21:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:29.596706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfab5b-1911-44a8-8c99-ea35651cc400 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:29.650839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:29.705583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfab5b-1911-44a8-8c99-ea35651cc400 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:29.740537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c7872-88c9-4edb-9b35-a3f5946cd37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:29.741230 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7872-88c9-4edb-9b35-a3f5946cd37c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:29.741512 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7872-88c9-4edb-9b35-a3f5946cd37c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:29.741787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7872-88c9-4edb-9b35-a3f5946cd37c None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:29.742581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c7872-88c9-4edb-9b35-a3f5946cd37c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:29.742894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c7872-88c9-4edb-9b35-a3f5946cd37c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:29.744352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c7872-88c9-4edb-9b35-a3f5946cd37c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:29.756798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 638/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Wed Jul 6 20:21:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:29.763165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62e28d-65c6-417e-a253-ce23c6290753 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:29.882445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62e28d-65c6-417e-a253-ce23c6290753 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:29.922316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf795ea2-7c5e-4a1f-9a0c-5cc038f2ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:29.922964 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf795ea2-7c5e-4a1f-9a0c-5cc038f2ec94 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:29.923240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf795ea2-7c5e-4a1f-9a0c-5cc038f2ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:29.923509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf795ea2-7c5e-4a1f-9a0c-5cc038f2ec94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:29.924334 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf795ea2-7c5e-4a1f-9a0c-5cc038f2ec94 None admin] RBAC: Adding query filter params (role.id=7ca953399e6f45258ff0a470ee4e5f7a, scope.project.id=fa631f63e06643bd98323366357c3597, user.id=e0df36a267464042908bbd8eebc7c40c) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:29.924645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf795ea2-7c5e-4a1f-9a0c-5cc038f2ec94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:29.926192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf795ea2-7c5e-4a1f-9a0c-5cc038f2ec94 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:29.932002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 649/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Wed Jul 6 20:21:29 2022] GET /identity/v3/role_assignments?user.id=e0df36a267464042908bbd8eebc7c40c&scope.project.id=fa631f63e06643bd98323366357c3597&role.id=7ca953399e6f45258ff0a470ee4e5f7a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:31.924824 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915c7e-ab07-48bb-8cdd-d610773d4401 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:31.925788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915c7e-ab07-48bb-8cdd-d610773d4401 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:31.925788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915c7e-ab07-48bb-8cdd-d610773d4401 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:31.927919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 639/1288] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:21:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:21:31.935844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f73a-397d-45c1-b4e1-f9c76d74eb81 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:31.936296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f73a-397d-45c1-b4e1-f9c76d74eb81 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:31.936394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f73a-397d-45c1-b4e1-f9c76d74eb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:31.955625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d219f73a-397d-45c1-b4e1-f9c76d74eb81 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:21:31.956784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d219f73a-397d-45c1-b4e1-f9c76d74eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:21:31.988043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:32.033758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 650/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:21:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:21:32.055504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f915c7e-ab07-48bb-8cdd-d610773d4401 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:32.163666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f915c7e-ab07-48bb-8cdd-d610773d4401 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:32.180622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:32.206260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b81fd-953b-48fb-bd99-0dd561099fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:32.207068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b81fd-953b-48fb-bd99-0dd561099fda None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:32.207347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b81fd-953b-48fb-bd99-0dd561099fda None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:32.207620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b81fd-953b-48fb-bd99-0dd561099fda None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:32.208281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b81fd-953b-48fb-bd99-0dd561099fda None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:32.209690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b81fd-953b-48fb-bd99-0dd561099fda None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d68b81fd-953b-48fb-bd99-0dd561099fda None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:32.222472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:32.223551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:32.229183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 640/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jul 6 20:21:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:32.233289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219f73a-397d-45c1-b4e1-f9c76d74eb81 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:32.342585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219f73a-397d-45c1-b4e1-f9c76d74eb81 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:32.380581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603f40f-3bbb-41c2-84d3-88be9ee9f20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:32.381258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603f40f-3bbb-41c2-84d3-88be9ee9f20d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:32.381533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603f40f-3bbb-41c2-84d3-88be9ee9f20d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:32.381800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603f40f-3bbb-41c2-84d3-88be9ee9f20d None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:32.382502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603f40f-3bbb-41c2-84d3-88be9ee9f20d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:32.382808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603f40f-3bbb-41c2-84d3-88be9ee9f20d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:32.384172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603f40f-3bbb-41c2-84d3-88be9ee9f20d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:32.389586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 651/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Jul 6 20:21:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:32.395980 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b81fd-953b-48fb-bd99-0dd561099fda None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:32.517178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b81fd-953b-48fb-bd99-0dd561099fda None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:32.563782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec4d3b-3760-4471-aa2c-c20ba241792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:32.564539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4d3b-3760-4471-aa2c-c20ba241792a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:32.564878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4d3b-3760-4471-aa2c-c20ba241792a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:32.565253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4d3b-3760-4471-aa2c-c20ba241792a None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:32.566061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec4d3b-3760-4471-aa2c-c20ba241792a None admin] RBAC: Adding query filter params (type=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:32.566473 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec4d3b-3760-4471-aa2c-c20ba241792a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:32.568099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec4d3b-3760-4471-aa2c-c20ba241792a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:32.573820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 641/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Jul 6 20:21:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:34.542143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180c27-0248-48ce-96d4-388d1c61d2c6 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:34.542762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180c27-0248-48ce-96d4-388d1c61d2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:34.542762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180c27-0248-48ce-96d4-388d1c61d2c6 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:34.544103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 652/1293] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:21:34.549779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd92b-1d22-4661-9f08-184b36a9dc5f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:34.550198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd92b-1d22-4661-9f08-184b36a9dc5f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:34.550302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd92b-1d22-4661-9f08-184b36a9dc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:34.576137 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3d5dd92b-1d22-4661-9f08-184b36a9dc5f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:21:34.577346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3d5dd92b-1d22-4661-9f08-184b36a9dc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:21:34.609281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:34.659030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 642/1294] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:21:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:21:34.681788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e180c27-0248-48ce-96d4-388d1c61d2c6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:34.715932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:34.792377 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e180c27-0248-48ce-96d4-388d1c61d2c6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:34.831043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6f6e3-d173-44a7-8a9e-c514135eb99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:34.831723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f6e3-d173-44a7-8a9e-c514135eb99d None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:34.832148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f6e3-d173-44a7-8a9e-c514135eb99d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:34.832641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f6e3-d173-44a7-8a9e-c514135eb99d None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:34.833999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6f6e3-d173-44a7-8a9e-c514135eb99d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:34.835568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6f6e3-d173-44a7-8a9e-c514135eb99d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:34.852121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 653/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Wed Jul 6 20:21:34 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:21:36.865532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193932f-308a-45db-a0bb-fe59cad360fc None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:36.866309 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193932f-308a-45db-a0bb-fe59cad360fc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:36.866463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193932f-308a-45db-a0bb-fe59cad360fc None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:36.868581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 643/1296] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:21:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:21:36.877494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83523467-bd60-4175-ab50-33e273e6ba50 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:36.877906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83523467-bd60-4175-ab50-33e273e6ba50 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:36.878094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83523467-bd60-4175-ab50-33e273e6ba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:36.898441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-83523467-bd60-4175-ab50-33e273e6ba50 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:21:36.899644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-83523467-bd60-4175-ab50-33e273e6ba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:21:36.987253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 654/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:21:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:21:37.011096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193932f-308a-45db-a0bb-fe59cad360fc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:37.122823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193932f-308a-45db-a0bb-fe59cad360fc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:37.157549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009b86e-8b17-4bd0-9e5c-43a31b512fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:37.158326 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b86e-8b17-4bd0-9e5c-43a31b512fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:37.158607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b86e-8b17-4bd0-9e5c-43a31b512fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:37.158878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b86e-8b17-4bd0-9e5c-43a31b512fc3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:37.159521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009b86e-8b17-4bd0-9e5c-43a31b512fc3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:37.160876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009b86e-8b17-4bd0-9e5c-43a31b512fc3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6009b86e-8b17-4bd0-9e5c-43a31b512fc3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:37.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:37.173908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:37.175120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 644/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jul 6 20:21:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:37.181900 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83523467-bd60-4175-ab50-33e273e6ba50 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:37.201921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:37.296522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83523467-bd60-4175-ab50-33e273e6ba50 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:37.333893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f751d3-4805-43da-97a6-20944835b66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:37.334549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f751d3-4805-43da-97a6-20944835b66d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:37.334830 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f751d3-4805-43da-97a6-20944835b66d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:37.335107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f751d3-4805-43da-97a6-20944835b66d None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:37.335818 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f751d3-4805-43da-97a6-20944835b66d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:37.336127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f751d3-4805-43da-97a6-20944835b66d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:37.337535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f751d3-4805-43da-97a6-20944835b66d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:37.342898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 655/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Jul 6 20:21:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:37.352455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009b86e-8b17-4bd0-9e5c-43a31b512fc3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:37.393947 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:37.464674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009b86e-8b17-4bd0-9e5c-43a31b512fc3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:37.503491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24d104-4210-49f8-959a-c031d656c95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:37.504138 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24d104-4210-49f8-959a-c031d656c95a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:37.504414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24d104-4210-49f8-959a-c031d656c95a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:37.504680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24d104-4210-49f8-959a-c031d656c95a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:37.505504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24d104-4210-49f8-959a-c031d656c95a None admin] RBAC: Adding query filter params (interface=public, service_id=6f35c9dca90246adbdde3632c951077e, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:37.505811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24d104-4210-49f8-959a-c031d656c95a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:37.507173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24d104-4210-49f8-959a-c031d656c95a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:37.512865 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 645/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Wed Jul 6 20:21:37 2022] GET /identity/v3/endpoints?service_id=6f35c9dca90246adbdde3632c951077e&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:37.518751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f751d3-4805-43da-97a6-20944835b66d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:37.612377 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:37.633792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f751d3-4805-43da-97a6-20944835b66d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:37.669534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577e7ea-ae8b-4c03-9570-712717434deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:37.670130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e7ea-ae8b-4c03-9570-712717434deb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:37.670418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e7ea-ae8b-4c03-9570-712717434deb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:37.670691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e7ea-ae8b-4c03-9570-712717434deb None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:37.671374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577e7ea-ae8b-4c03-9570-712717434deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:37.672745 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577e7ea-ae8b-4c03-9570-712717434deb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:37.680007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 656/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Wed Jul 6 20:21:37 2022] GET /identity/v3/services => generated 2191 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:21:39.666479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf178-bbd1-4c1b-a490-4d929f41e9d6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:39.667048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf178-bbd1-4c1b-a490-4d929f41e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:39.667181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf178-bbd1-4c1b-a490-4d929f41e9d6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:39.669295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 646/1302] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:21:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:21:39.674705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762e328-3d49-46fe-b31d-fbaa1ff91427 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:39.675133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762e328-3d49-46fe-b31d-fbaa1ff91427 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:39.675257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762e328-3d49-46fe-b31d-fbaa1ff91427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:39.694040 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9762e328-3d49-46fe-b31d-fbaa1ff91427 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:21:39.695212 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9762e328-3d49-46fe-b31d-fbaa1ff91427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:21:39.763197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 657/1303] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:21:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:21:39.786101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bf178-bbd1-4c1b-a490-4d929f41e9d6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:39.890398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:39.902129 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bf178-bbd1-4c1b-a490-4d929f41e9d6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:39.943865 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b07a9d-0f42-4875-b6e7-60679726189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:39.944605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b07a9d-0f42-4875-b6e7-60679726189e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:39.944882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b07a9d-0f42-4875-b6e7-60679726189e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:39.945186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b07a9d-0f42-4875-b6e7-60679726189e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:39.945841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b07a9d-0f42-4875-b6e7-60679726189e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:39.947207 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b07a9d-0f42-4875-b6e7-60679726189e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c0b07a9d-0f42-4875-b6e7-60679726189e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:21:39.966807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:21:39.968552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 06 20:21:39.969887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 647/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Wed Jul 6 20:21:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:21:39.978439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762e328-3d49-46fe-b31d-fbaa1ff91427 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:40.058037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:40.085514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762e328-3d49-46fe-b31d-fbaa1ff91427 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:40.123632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f6643-9a38-4e93-9ff7-0759c2b2c0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:40.124281 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f6643-9a38-4e93-9ff7-0759c2b2c0fd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:40.124565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f6643-9a38-4e93-9ff7-0759c2b2c0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:40.124836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f6643-9a38-4e93-9ff7-0759c2b2c0fd None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:40.125580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f6643-9a38-4e93-9ff7-0759c2b2c0fd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:21:40.125892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f6643-9a38-4e93-9ff7-0759c2b2c0fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:40.127259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f6643-9a38-4e93-9ff7-0759c2b2c0fd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:40.132501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 658/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Wed Jul 6 20:21:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:21:40.139696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b07a9d-0f42-4875-b6e7-60679726189e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:21:40.263717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b07a9d-0f42-4875-b6e7-60679726189e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:21:40.299452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7730e5-2c37-4fca-b058-f1d9173290f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:21:40.300091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730e5-2c37-4fca-b058-f1d9173290f2 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:21:40.300369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730e5-2c37-4fca-b058-f1d9173290f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:21:40.300642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730e5-2c37-4fca-b058-f1d9173290f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:21:40.301430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7730e5-2c37-4fca-b058-f1d9173290f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:21:40.302798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7730e5-2c37-4fca-b058-f1d9173290f2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:21:40.323947 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 648/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Wed Jul 6 20:21:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:21:50.129595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=30 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:21:50.319440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:42.738487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a2cdd-4853-4f2c-94d4-98a912c6dfae None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:42.739105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a2cdd-4853-4f2c-94d4-98a912c6dfae None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:42.739105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a2cdd-4853-4f2c-94d4-98a912c6dfae None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:42.745035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 659/1307] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:22:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:22:42.746517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb7dde-eb87-48c3-b297-dbde1e225d48 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:42.746943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb7dde-eb87-48c3-b297-dbde1e225d48 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:42.747044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb7dde-eb87-48c3-b297-dbde1e225d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:42.921391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-94cb7dde-eb87-48c3-b297-dbde1e225d48 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:22:42.922844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-94cb7dde-eb87-48c3-b297-dbde1e225d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:43.159582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 649/1308] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:22:43.230734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7571f-7c49-4b9f-b33c-c1eb32f93288 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:43.230936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7571f-7c49-4b9f-b33c-c1eb32f93288 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:43.231209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7571f-7c49-4b9f-b33c-c1eb32f93288 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:43.237399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 660/1309] 10.222.0.30 () {54 vars in 964 bytes} [Wed Jul 6 20:22:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:22:43.247128 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0cbe5-65e2-4f7e-84c6-6cbc890bfb32 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:43.247841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0cbe5-65e2-4f7e-84c6-6cbc890bfb32 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:43.248527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0cbe5-65e2-4f7e-84c6-6cbc890bfb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:43.409640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-39a0cbe5-65e2-4f7e-84c6-6cbc890bfb32 None None] MFA Rules not processed for user `1c5ad3094ee04495a6ab82c92d458aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:22:43.411358 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-39a0cbe5-65e2-4f7e-84c6-6cbc890bfb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:43.437046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:43.508045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 650/1310] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Jul 6 20:22:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:22:43.517206 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7571f-7c49-4b9f-b33c-c1eb32f93288 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:22:43.518968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a5b7571f-7c49-4b9f-b33c-c1eb32f93288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:43.657572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7571f-7c49-4b9f-b33c-c1eb32f93288 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:22:43.746260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d698f-7b86-45eb-ae35-59d9bc406cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:22:43.747799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d698f-7b86-45eb-ae35-59d9bc406cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:43.748233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d698f-7b86-45eb-ae35-59d9bc406cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:43.748695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d698f-7b86-45eb-ae35-59d9bc406cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:43.750900 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-739d698f-7b86-45eb-ae35-59d9bc406cd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:43.812092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:43.878414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d698f-7b86-45eb-ae35-59d9bc406cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:22:43.880342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d698f-7b86-45eb-ae35-59d9bc406cd2 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:22:43.901538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 661/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:22:46.327610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf793-9ce4-4f3f-8db6-1bba35f4375e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:46.328213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf793-9ce4-4f3f-8db6-1bba35f4375e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:46.328213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf793-9ce4-4f3f-8db6-1bba35f4375e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:46.329551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 651/1312] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:22:46.334841 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086146e-2e80-4918-891c-82d89cf87378 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:46.335261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086146e-2e80-4918-891c-82d89cf87378 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:46.335350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086146e-2e80-4918-891c-82d89cf87378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:46.415430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f086146e-2e80-4918-891c-82d89cf87378 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:22:46.416673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f086146e-2e80-4918-891c-82d89cf87378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:46.517539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 662/1313] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:22:46.555277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cf793-9ce4-4f3f-8db6-1bba35f4375e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:22:46.557151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a27cf793-9ce4-4f3f-8db6-1bba35f4375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:46.671491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cf793-9ce4-4f3f-8db6-1bba35f4375e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:22:46.748740 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:46.751856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a5cc0-e000-4999-bb1a-75326100b050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:22:46.752768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a5cc0-e000-4999-bb1a-75326100b050 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:46.753111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a5cc0-e000-4999-bb1a-75326100b050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:46.753637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a5cc0-e000-4999-bb1a-75326100b050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:46.755646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-999a5cc0-e000-4999-bb1a-75326100b050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:46.873919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a5cc0-e000-4999-bb1a-75326100b050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:22:46.875369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a5cc0-e000-4999-bb1a-75326100b050 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:22:46.894351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 652/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:22:49.231644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db1244-6ebc-4876-8bee-271c1b5d896e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:49.232493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db1244-6ebc-4876-8bee-271c1b5d896e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:49.232622 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db1244-6ebc-4876-8bee-271c1b5d896e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:49.234770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 663/1315] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:22:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:22:49.240121 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164589-983b-4698-a016-b793988438f1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:49.240540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164589-983b-4698-a016-b793988438f1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:49.240630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164589-983b-4698-a016-b793988438f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:49.312920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-84164589-983b-4698-a016-b793988438f1 None None] MFA Rules not processed for user `14f59e7f0e4d4ba5b71ec440051ccf12`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:22:49.314164 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-84164589-983b-4698-a016-b793988438f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:49.382827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:49.435458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 653/1316] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:22:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:22:49.474386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db1244-6ebc-4876-8bee-271c1b5d896e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:22:49.475958 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b0db1244-6ebc-4876-8bee-271c1b5d896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:49.486271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:49.584766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db1244-6ebc-4876-8bee-271c1b5d896e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:22:49.665107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2568c6-231a-4018-8e18-1af113f85d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:22:49.665755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2568c6-231a-4018-8e18-1af113f85d8f service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:49.666034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2568c6-231a-4018-8e18-1af113f85d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:49.666308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2568c6-231a-4018-8e18-1af113f85d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:49.667970 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0b2568c6-231a-4018-8e18-1af113f85d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:49.740247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:49.788274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2568c6-231a-4018-8e18-1af113f85d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:22:49.789723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2568c6-231a-4018-8e18-1af113f85d8f service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:22:49.810336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 664/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:22:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:22:52.376345 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf3d75-3000-495c-8890-0d4305240546 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:52.377261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf3d75-3000-495c-8890-0d4305240546 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:52.377261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf3d75-3000-495c-8890-0d4305240546 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:52.379444 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 654/1318] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:22:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:22:52.388073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760f102-9990-4454-84b9-c8395c471f2d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:52.388493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760f102-9990-4454-84b9-c8395c471f2d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:52.388693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760f102-9990-4454-84b9-c8395c471f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:52.467240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9760f102-9990-4454-84b9-c8395c471f2d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:22:52.468435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9760f102-9990-4454-84b9-c8395c471f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:52.574624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 665/1319] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:22:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:22:52.639269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7889997-f27f-48ad-908b-165dcfe5109b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:52.639477 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7889997-f27f-48ad-908b-165dcfe5109b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:52.639906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7889997-f27f-48ad-908b-165dcfe5109b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:52.642108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 655/1320] 10.222.0.30 () {54 vars in 964 bytes} [Wed Jul 6 20:22:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:22:52.650532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c98da-68ab-4fbd-a74b-4093af508fdb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:52.650823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c98da-68ab-4fbd-a74b-4093af508fdb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:52.651121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c98da-68ab-4fbd-a74b-4093af508fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:52.672826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:52.733961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a91c98da-68ab-4fbd-a74b-4093af508fdb None None] MFA Rules not processed for user `1c5ad3094ee04495a6ab82c92d458aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:22:52.735148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a91c98da-68ab-4fbd-a74b-4093af508fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:52.820193 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 666/1321] 10.222.0.30 () {58 vars in 1061 bytes} [Wed Jul 6 20:22:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:22:52.830889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7889997-f27f-48ad-908b-165dcfe5109b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:22:52.833352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f7889997-f27f-48ad-908b-165dcfe5109b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:52.941916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7889997-f27f-48ad-908b-165dcfe5109b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:22:53.016068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528fc56-2aef-4951-8f55-f66beddae51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:22:53.016707 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528fc56-2aef-4951-8f55-f66beddae51e service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:53.016997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528fc56-2aef-4951-8f55-f66beddae51e service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:53.017267 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528fc56-2aef-4951-8f55-f66beddae51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:53.018905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b528fc56-2aef-4951-8f55-f66beddae51e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:53.026308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:53.134605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528fc56-2aef-4951-8f55-f66beddae51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:22:53.136925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528fc56-2aef-4951-8f55-f66beddae51e service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:22:53.157751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 656/1322] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:22:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:22:56.289683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995e8a-fce2-4a40-becb-89d087c27f74 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:56.290256 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995e8a-fce2-4a40-becb-89d087c27f74 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:56.290256 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995e8a-fce2-4a40-becb-89d087c27f74 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:56.291570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 667/1323] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:22:56.296888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02f243-35d8-4a33-aaf2-16a83713da64 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:56.297392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02f243-35d8-4a33-aaf2-16a83713da64 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:56.297498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02f243-35d8-4a33-aaf2-16a83713da64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:56.362925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4e02f243-35d8-4a33-aaf2-16a83713da64 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:22:56.364130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4e02f243-35d8-4a33-aaf2-16a83713da64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:56.423932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:56.470216 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 657/1324] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:22:56.506458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2995e8a-fce2-4a40-becb-89d087c27f74 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:22:56.507998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d2995e8a-fce2-4a40-becb-89d087c27f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:56.624745 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2995e8a-fce2-4a40-becb-89d087c27f74 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:22:56.637744 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:56.701286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dc8bc-e535-4347-aa67-f4360741a108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:22:56.701948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dc8bc-e535-4347-aa67-f4360741a108 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:56.702225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dc8bc-e535-4347-aa67-f4360741a108 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:56.702492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dc8bc-e535-4347-aa67-f4360741a108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:56.704149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cb7dc8bc-e535-4347-aa67-f4360741a108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:56.818020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dc8bc-e535-4347-aa67-f4360741a108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:22:56.819462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dc8bc-e535-4347-aa67-f4360741a108 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:22:56.840590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 668/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:22:58.906603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f4ad7-ef50-4d95-a5e4-2a152968afac None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:58.907141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f4ad7-ef50-4d95-a5e4-2a152968afac None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:58.907141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f4ad7-ef50-4d95-a5e4-2a152968afac None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:58.908533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 658/1326] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:22:58.913706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c39d4-352c-4989-b726-5691abb2eac8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:58.914144 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c39d4-352c-4989-b726-5691abb2eac8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:58.914255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c39d4-352c-4989-b726-5691abb2eac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:58.962223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:58.981685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-369c39d4-352c-4989-b726-5691abb2eac8 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:22:58.982877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-369c39d4-352c-4989-b726-5691abb2eac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:59.086489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 669/1327] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:22:59.122364 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f4ad7-ef50-4d95-a5e4-2a152968afac None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:22:59.123955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bb2f4ad7-ef50-4d95-a5e4-2a152968afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:59.234373 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f4ad7-ef50-4d95-a5e4-2a152968afac None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:22:59.313045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e37878-f9aa-48b0-b5f4-3c9c0477f54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:22:59.313699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e37878-f9aa-48b0-b5f4-3c9c0477f54c service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:22:59.313976 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e37878-f9aa-48b0-b5f4-3c9c0477f54c service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:22:59.314243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e37878-f9aa-48b0-b5f4-3c9c0477f54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:22:59.316132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d8e37878-f9aa-48b0-b5f4-3c9c0477f54c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:22:59.334839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:22:59.442868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e37878-f9aa-48b0-b5f4-3c9c0477f54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:22:59.444328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e37878-f9aa-48b0-b5f4-3c9c0477f54c service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:22:59.465568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 659/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:01.570318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470760b5-ce66-4cc9-87ec-c7d314bebd3d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:01.570871 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470760b5-ce66-4cc9-87ec-c7d314bebd3d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:01.570871 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470760b5-ce66-4cc9-87ec-c7d314bebd3d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:01.572237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 670/1329] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:01.577910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c0e6-8ed0-401d-9ca6-4d85a06a21c2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:01.578728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c0e6-8ed0-401d-9ca6-4d85a06a21c2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:01.578728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c0e6-8ed0-401d-9ca6-4d85a06a21c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:01.654279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ac45c0e6-8ed0-401d-9ca6-4d85a06a21c2 None None] MFA Rules not processed for user `14f59e7f0e4d4ba5b71ec440051ccf12`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:01.655510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ac45c0e6-8ed0-401d-9ca6-4d85a06a21c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:01.723914 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:01.758375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 660/1330] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:01.799723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470760b5-ce66-4cc9-87ec-c7d314bebd3d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:01.801293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-470760b5-ce66-4cc9-87ec-c7d314bebd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:01.907943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470760b5-ce66-4cc9-87ec-c7d314bebd3d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:01.930720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:01.992394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87855f-9052-4ba7-b203-9a980122c06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:01.993106 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87855f-9052-4ba7-b203-9a980122c06f service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:01.993386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87855f-9052-4ba7-b203-9a980122c06f service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:01.993706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87855f-9052-4ba7-b203-9a980122c06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:01.995335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8f87855f-9052-4ba7-b203-9a980122c06f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:02.124394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87855f-9052-4ba7-b203-9a980122c06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:02.125876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87855f-9052-4ba7-b203-9a980122c06f service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:02.146149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 671/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:04.399097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ba911-00a5-49bb-8d77-cc9cdec5661d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:04.399684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ba911-00a5-49bb-8d77-cc9cdec5661d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:04.399684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ba911-00a5-49bb-8d77-cc9cdec5661d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:04.401003 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 661/1332] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:04.407374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8832e34-241c-4ac4-b36d-e7950f5dd615 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:04.408089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8832e34-241c-4ac4-b36d-e7950f5dd615 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:04.408280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8832e34-241c-4ac4-b36d-e7950f5dd615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:04.478679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:04.481492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c8832e34-241c-4ac4-b36d-e7950f5dd615 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:04.483414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c8832e34-241c-4ac4-b36d-e7950f5dd615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:04.589453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 672/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:04.626068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ba911-00a5-49bb-8d77-cc9cdec5661d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:04.628121 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-881ba911-00a5-49bb-8d77-cc9cdec5661d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:04.738501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ba911-00a5-49bb-8d77-cc9cdec5661d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:04.817227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cefe38-6df5-48f9-917f-8cf664acdeb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:04.817901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cefe38-6df5-48f9-917f-8cf664acdeb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:04.818183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cefe38-6df5-48f9-917f-8cf664acdeb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:04.818456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cefe38-6df5-48f9-917f-8cf664acdeb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:04.820087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-04cefe38-6df5-48f9-917f-8cf664acdeb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:04.848085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:04.936915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cefe38-6df5-48f9-917f-8cf664acdeb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:04.938543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cefe38-6df5-48f9-917f-8cf664acdeb0 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:04.962082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 662/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:07.029008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb2373-ab66-4cea-b9fc-67d678681d42 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:07.029834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb2373-ab66-4cea-b9fc-67d678681d42 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:07.030004 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb2373-ab66-4cea-b9fc-67d678681d42 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:07.032198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 673/1335] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:07.037843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59d60-ed98-4b6a-975a-123437a7e57b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:07.038286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59d60-ed98-4b6a-975a-123437a7e57b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:07.038376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59d60-ed98-4b6a-975a-123437a7e57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:07.115698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1ca59d60-ed98-4b6a-975a-123437a7e57b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:07.116805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1ca59d60-ed98-4b6a-975a-123437a7e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:07.192477 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:07.215913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 663/1336] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:07.259761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb2373-ab66-4cea-b9fc-67d678681d42 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:07.262274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-decb2373-ab66-4cea-b9fc-67d678681d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:07.372366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb2373-ab66-4cea-b9fc-67d678681d42 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:07.405669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:07.463858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b826f-fdbd-42d6-a418-1bc52a4e8b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:07.464510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b826f-fdbd-42d6-a418-1bc52a4e8b82 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:07.464788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b826f-fdbd-42d6-a418-1bc52a4e8b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:07.465087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b826f-fdbd-42d6-a418-1bc52a4e8b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:07.466737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-795b826f-fdbd-42d6-a418-1bc52a4e8b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:07.585439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b826f-fdbd-42d6-a418-1bc52a4e8b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:07.586935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b826f-fdbd-42d6-a418-1bc52a4e8b82 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:07.606807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 674/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:09.941502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ac94-2a27-424c-b571-cb1b667ec22f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:09.942311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ac94-2a27-424c-b571-cb1b667ec22f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:09.942593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ac94-2a27-424c-b571-cb1b667ec22f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:09.944833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 664/1338] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:09.951147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce33490-4f85-41e7-9f1d-c32eb483c65a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:09.951584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce33490-4f85-41e7-9f1d-c32eb483c65a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:09.951733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce33490-4f85-41e7-9f1d-c32eb483c65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:10.034265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fce33490-4f85-41e7-9f1d-c32eb483c65a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:10.035386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fce33490-4f85-41e7-9f1d-c32eb483c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:10.044235 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:10.145521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 675/1339] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:10.192271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ac94-2a27-424c-b571-cb1b667ec22f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:10.193840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1e15ac94-2a27-424c-b571-cb1b667ec22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:10.314901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ac94-2a27-424c-b571-cb1b667ec22f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:10.400712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be3128-3cbf-4253-8ea0-7aba1a55c3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:10.401393 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be3128-3cbf-4253-8ea0-7aba1a55c3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:10.401672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be3128-3cbf-4253-8ea0-7aba1a55c3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:10.401948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be3128-3cbf-4253-8ea0-7aba1a55c3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:10.403591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-66be3128-3cbf-4253-8ea0-7aba1a55c3b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:10.438973 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:10.514293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be3128-3cbf-4253-8ea0-7aba1a55c3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:10.515739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be3128-3cbf-4253-8ea0-7aba1a55c3b8 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:10.534761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 665/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:23:14.594163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb77fb0-8ecf-419b-a89a-94766518c1cc None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:14.594685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb77fb0-8ecf-419b-a89a-94766518c1cc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:14.594685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb77fb0-8ecf-419b-a89a-94766518c1cc None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:14.596105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 676/1341] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:14.602547 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f76b9-727f-4add-8553-ac6d6a9816f9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:14.603057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f76b9-727f-4add-8553-ac6d6a9816f9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:14.603057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f76b9-727f-4add-8553-ac6d6a9816f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:14.680247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ab3f76b9-727f-4add-8553-ac6d6a9816f9 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:14.681535 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ab3f76b9-727f-4add-8553-ac6d6a9816f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:14.782949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:14.797474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 666/1342] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:14.836058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb77fb0-8ecf-419b-a89a-94766518c1cc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:14.838347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6cb77fb0-8ecf-419b-a89a-94766518c1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:14.940445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb77fb0-8ecf-419b-a89a-94766518c1cc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:14.944713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190153c-9222-4e97-a7a3-2caa4d156007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:14.945472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190153c-9222-4e97-a7a3-2caa4d156007 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:14.945815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190153c-9222-4e97-a7a3-2caa4d156007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:14.946152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190153c-9222-4e97-a7a3-2caa4d156007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:14.956385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190153c-9222-4e97-a7a3-2caa4d156007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:14.957992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190153c-9222-4e97-a7a3-2caa4d156007 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:14.967531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 677/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:17.610491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843e43-8b4e-4678-ba55-fe7bb6f56386 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:17.611086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843e43-8b4e-4678-ba55-fe7bb6f56386 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:17.611086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843e43-8b4e-4678-ba55-fe7bb6f56386 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:17.612668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 667/1344] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:17.618396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f37b3-2964-4f17-967e-99d93d367d7c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:17.618892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f37b3-2964-4f17-967e-99d93d367d7c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:17.618987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f37b3-2964-4f17-967e-99d93d367d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:17.648254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b49f37b3-2964-4f17-967e-99d93d367d7c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:17.649481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b49f37b3-2964-4f17-967e-99d93d367d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:17.679446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:17.736364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 678/1345] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:17.774392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56843e43-8b4e-4678-ba55-fe7bb6f56386 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:17.786465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56843e43-8b4e-4678-ba55-fe7bb6f56386 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:17.793723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42417b4-6c7c-410d-b495-b1f48bae3946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:17.794760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42417b4-6c7c-410d-b495-b1f48bae3946 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:17.795205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42417b4-6c7c-410d-b495-b1f48bae3946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:17.795553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42417b4-6c7c-410d-b495-b1f48bae3946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:17.808261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42417b4-6c7c-410d-b495-b1f48bae3946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:17.809909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42417b4-6c7c-410d-b495-b1f48bae3946 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:17.821846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 668/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:21.884202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc4165-e6d7-4cee-a1e6-bc025439eb83 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:21.884768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc4165-e6d7-4cee-a1e6-bc025439eb83 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:21.884768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc4165-e6d7-4cee-a1e6-bc025439eb83 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:21.886189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 679/1347] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:21.891513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265982d-4853-4a5d-9c35-263a1847ef32 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:21.891931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265982d-4853-4a5d-9c35-263a1847ef32 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:21.892137 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265982d-4853-4a5d-9c35-263a1847ef32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:21.909925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1265982d-4853-4a5d-9c35-263a1847ef32 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:21.911214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1265982d-4853-4a5d-9c35-263a1847ef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:21.919267 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 669/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:23:21.957911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc4165-e6d7-4cee-a1e6-bc025439eb83 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:21.969972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc4165-e6d7-4cee-a1e6-bc025439eb83 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:21.973970 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c04514-2427-49f2-998b-b8a555951b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:21.974616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04514-2427-49f2-998b-b8a555951b36 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:21.974899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04514-2427-49f2-998b-b8a555951b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:21.975172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04514-2427-49f2-998b-b8a555951b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:21.985214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c04514-2427-49f2-998b-b8a555951b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:21.986811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c04514-2427-49f2-998b-b8a555951b36 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:21.997704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 680/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:26.993386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8fc8-0cc1-49c2-b965-4ed213947591 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:26.994390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8fc8-0cc1-49c2-b965-4ed213947591 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:26.994888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8fc8-0cc1-49c2-b965-4ed213947591 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:26.996763 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 670/1350] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:27.002089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913acf57-f374-4da3-a3d3-e1b0d69e3872 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:27.002570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913acf57-f374-4da3-a3d3-e1b0d69e3872 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:27.002741 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913acf57-f374-4da3-a3d3-e1b0d69e3872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:27.077679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-913acf57-f374-4da3-a3d3-e1b0d69e3872 None None] MFA Rules not processed for user `e0df36a267464042908bbd8eebc7c40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:27.079209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-913acf57-f374-4da3-a3d3-e1b0d69e3872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:27.176173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 681/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:23:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:31.251028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7576c97-22f3-427b-9c8a-0706150d412b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:31.251607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7576c97-22f3-427b-9c8a-0706150d412b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:31.251801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7576c97-22f3-427b-9c8a-0706150d412b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:31.253614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 671/1352] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:31.258886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6ea5-9816-4004-a9ae-894a338f5406 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:31.259353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6ea5-9816-4004-a9ae-894a338f5406 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:31.259632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6ea5-9816-4004-a9ae-894a338f5406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:31.280352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d37e6ea5-9816-4004-a9ae-894a338f5406 None None] MFA Rules not processed for user `e0df36a267464042908bbd8eebc7c40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:31.281710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d37e6ea5-9816-4004-a9ae-894a338f5406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:31.291648 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 682/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:23:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:23:31.905431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=13 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:32.924158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc860ff5-31ea-4a43-8754-3145f8bcce2c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:32.924911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc860ff5-31ea-4a43-8754-3145f8bcce2c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:32.924911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc860ff5-31ea-4a43-8754-3145f8bcce2c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:32.926184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 672/1354] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:32.931194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd948a97-d79d-479a-9e97-3b62f782a443 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:32.931614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd948a97-d79d-479a-9e97-3b62f782a443 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:32.931868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd948a97-d79d-479a-9e97-3b62f782a443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:32.950357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bd948a97-d79d-479a-9e97-3b62f782a443 None None] MFA Rules not processed for user `e0df36a267464042908bbd8eebc7c40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:32.951675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bd948a97-d79d-479a-9e97-3b62f782a443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:32.960826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 683/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:23:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:36.564306 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5714e2-3f32-4d7a-9914-b0768a44ff30 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:36.564817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5714e2-3f32-4d7a-9914-b0768a44ff30 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:36.564817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5714e2-3f32-4d7a-9914-b0768a44ff30 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:36.566401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 673/1356] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:36.571944 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7351-46a8-479c-bcfe-0302aa95e43b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:36.572388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7351-46a8-479c-bcfe-0302aa95e43b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:36.572501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7351-46a8-479c-bcfe-0302aa95e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:36.593999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d49c7351-46a8-479c-bcfe-0302aa95e43b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:36.595578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d49c7351-46a8-479c-bcfe-0302aa95e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:36.606079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 684/1357] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:36.659748 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe106-2e38-4ce0-8558-7d57c6c06b68 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:36.660755 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe106-2e38-4ce0-8558-7d57c6c06b68 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:36.661283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe106-2e38-4ce0-8558-7d57c6c06b68 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:36.663810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 674/1358] 10.222.0.30 () {54 vars in 961 bytes} [Wed Jul 6 20:23:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:23:36.672299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c654e-1b16-4aa0-994e-ef42c58137d8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:36.672584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c654e-1b16-4aa0-994e-ef42c58137d8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:36.677793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c654e-1b16-4aa0-994e-ef42c58137d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:36.724716 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:36.734301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-145c654e-1b16-4aa0-994e-ef42c58137d8 None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:36.736267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-145c654e-1b16-4aa0-994e-ef42c58137d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:36.840720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 685/1359] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Jul 6 20:23:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:36.849577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fe106-2e38-4ce0-8558-7d57c6c06b68 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:36.865931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fe106-2e38-4ce0-8558-7d57c6c06b68 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:36.871661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3029037-2c9d-42a7-99f2-5edb673ba49a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:36.872701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3029037-2c9d-42a7-99f2-5edb673ba49a service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:36.873236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3029037-2c9d-42a7-99f2-5edb673ba49a service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:36.873802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3029037-2c9d-42a7-99f2-5edb673ba49a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:36.882890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3029037-2c9d-42a7-99f2-5edb673ba49a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:36.884732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3029037-2c9d-42a7-99f2-5edb673ba49a service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:36.895080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 675/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:23:39.137558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4440-a650-451f-a92c-170525322957 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:39.138142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4440-a650-451f-a92c-170525322957 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:39.138142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4440-a650-451f-a92c-170525322957 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:39.139715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 686/1361] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:39.144982 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb2bc-5540-4387-829b-220f4cd75df3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:39.145446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb2bc-5540-4387-829b-220f4cd75df3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:39.145539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb2bc-5540-4387-829b-220f4cd75df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:39.163699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ba2eb2bc-5540-4387-829b-220f4cd75df3 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:39.164924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ba2eb2bc-5540-4387-829b-220f4cd75df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:39.173321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 676/1362] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:39.218023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e4440-a650-451f-a92c-170525322957 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:39.233960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e4440-a650-451f-a92c-170525322957 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:39.242585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa55db-2b2f-46e9-9ebd-69275273fd7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:39.243391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa55db-2b2f-46e9-9ebd-69275273fd7d service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:39.243784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa55db-2b2f-46e9-9ebd-69275273fd7d service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:39.244168 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa55db-2b2f-46e9-9ebd-69275273fd7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:39.253381 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa55db-2b2f-46e9-9ebd-69275273fd7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:39.255191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa55db-2b2f-46e9-9ebd-69275273fd7d service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:39.265550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 687/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:41.593369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ea5ef-0fd0-49a4-88b8-216af8c33978 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:41.593898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ea5ef-0fd0-49a4-88b8-216af8c33978 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:41.593898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ea5ef-0fd0-49a4-88b8-216af8c33978 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:41.595442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 677/1364] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:41.600578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80465e77-1558-4625-b06d-9e2b0eab876c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:41.601356 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80465e77-1558-4625-b06d-9e2b0eab876c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:41.601640 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80465e77-1558-4625-b06d-9e2b0eab876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:41.626146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-80465e77-1558-4625-b06d-9e2b0eab876c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:41.627565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-80465e77-1558-4625-b06d-9e2b0eab876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:41.645442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 688/1365] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:41.684192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9be27-eaef-4f53-a9aa-653c156c3b0e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:41.684482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9be27-eaef-4f53-a9aa-653c156c3b0e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:41.684764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9be27-eaef-4f53-a9aa-653c156c3b0e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:41.686431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 678/1366] 10.222.0.30 () {54 vars in 961 bytes} [Wed Jul 6 20:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:41.691580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3bd69-10f8-4dc1-8646-dfed11d4bac8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:41.691869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3bd69-10f8-4dc1-8646-dfed11d4bac8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:41.692142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3bd69-10f8-4dc1-8646-dfed11d4bac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:41.710447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dfe3bd69-10f8-4dc1-8646-dfed11d4bac8 None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:41.711647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dfe3bd69-10f8-4dc1-8646-dfed11d4bac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:41.721199 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 689/1367] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Jul 6 20:23:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:41.729026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9be27-eaef-4f53-a9aa-653c156c3b0e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:41.743683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9be27-eaef-4f53-a9aa-653c156c3b0e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:41.749187 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfa5e9-8d52-41ca-9e73-9ac7b5afbca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:41.749909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa5e9-8d52-41ca-9e73-9ac7b5afbca3 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:41.750250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa5e9-8d52-41ca-9e73-9ac7b5afbca3 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:41.750580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa5e9-8d52-41ca-9e73-9ac7b5afbca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:41.758574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfa5e9-8d52-41ca-9e73-9ac7b5afbca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:41.760221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfa5e9-8d52-41ca-9e73-9ac7b5afbca3 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:41.770703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 679/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:43.858961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caee037-22e4-4f75-999f-296be50b506f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:43.859508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caee037-22e4-4f75-999f-296be50b506f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:43.859508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caee037-22e4-4f75-999f-296be50b506f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:43.860844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 690/1369] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:43.866539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ed2f-6e99-43f2-9608-7eab1353aba6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:43.866986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ed2f-6e99-43f2-9608-7eab1353aba6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:43.867067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ed2f-6e99-43f2-9608-7eab1353aba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:43.885573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-49d8ed2f-6e99-43f2-9608-7eab1353aba6 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:43.886785 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-49d8ed2f-6e99-43f2-9608-7eab1353aba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:43.895881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 680/1370] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:23:43.939355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caee037-22e4-4f75-999f-296be50b506f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:43.954243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caee037-22e4-4f75-999f-296be50b506f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:43.959763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539d5ea-21af-448c-9862-48dbbe41bfec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:43.960400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d5ea-21af-448c-9862-48dbbe41bfec service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:43.960678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d5ea-21af-448c-9862-48dbbe41bfec service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:43.960928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d5ea-21af-448c-9862-48dbbe41bfec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:43.970027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539d5ea-21af-448c-9862-48dbbe41bfec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:43.971774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539d5ea-21af-448c-9862-48dbbe41bfec service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:43.982724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 691/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:44.600573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aad6e-25ac-4ef5-ae2e-e168d17bc13c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:44.600810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aad6e-25ac-4ef5-ae2e-e168d17bc13c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:44.601113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aad6e-25ac-4ef5-ae2e-e168d17bc13c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:44.602657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 681/1372] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:44.608251 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e24d3e-48b9-4b90-9fc8-2643e6475639 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:44.608737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e24d3e-48b9-4b90-9fc8-2643e6475639 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:44.609239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e24d3e-48b9-4b90-9fc8-2643e6475639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:44.627983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-24e24d3e-48b9-4b90-9fc8-2643e6475639 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:44.629185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-24e24d3e-48b9-4b90-9fc8-2643e6475639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:44.637308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 692/1373] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:44.941583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e83165-b958-4843-9312-2f5622c32f63 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:44.942411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e83165-b958-4843-9312-2f5622c32f63 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:44.942653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e83165-b958-4843-9312-2f5622c32f63 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:44.944192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 682/1374] 10.222.0.30 () {54 vars in 963 bytes} [Wed Jul 6 20:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:44.949482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896ba4c-fad6-4cd2-a588-cd5ec8b3f190 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:44.949951 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896ba4c-fad6-4cd2-a588-cd5ec8b3f190 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:44.950035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896ba4c-fad6-4cd2-a588-cd5ec8b3f190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:45.002436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c896ba4c-fad6-4cd2-a588-cd5ec8b3f190 None None] MFA Rules not processed for user `344585d4cf44449e8b040d635fe45c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:45.003572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c896ba4c-fad6-4cd2-a588-cd5ec8b3f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:45.065856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 693/1375] 10.222.0.30 () {58 vars in 1060 bytes} [Wed Jul 6 20:23:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:45.073398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e83165-b958-4843-9312-2f5622c32f63 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:45.084688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e83165-b958-4843-9312-2f5622c32f63 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:45.088268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934537e6-9b48-4fd2-b950-9edc30e4d6eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:45.088910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934537e6-9b48-4fd2-b950-9edc30e4d6eb service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:45.089202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934537e6-9b48-4fd2-b950-9edc30e4d6eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:45.089670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934537e6-9b48-4fd2-b950-9edc30e4d6eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:45.099653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934537e6-9b48-4fd2-b950-9edc30e4d6eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:45.101317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934537e6-9b48-4fd2-b950-9edc30e4d6eb service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:45.112289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 683/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:46.062713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432bf0-6360-4380-934b-667a24df92d1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:46.063312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432bf0-6360-4380-934b-667a24df92d1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:46.063312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432bf0-6360-4380-934b-667a24df92d1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:46.064620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 694/1377] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:46.070181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38f170-fee6-4e09-8120-9407cfdcc393 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:46.070618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38f170-fee6-4e09-8120-9407cfdcc393 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:46.070849 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38f170-fee6-4e09-8120-9407cfdcc393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:46.088395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-be38f170-fee6-4e09-8120-9407cfdcc393 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:46.089801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-be38f170-fee6-4e09-8120-9407cfdcc393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:46.097727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 684/1378] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:46.141723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93432bf0-6360-4380-934b-667a24df92d1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:46.156969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93432bf0-6360-4380-934b-667a24df92d1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:46.162777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254691b-c40b-4b11-9e2b-d8d6d872b109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:46.163451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254691b-c40b-4b11-9e2b-d8d6d872b109 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:46.163758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254691b-c40b-4b11-9e2b-d8d6d872b109 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:46.164054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254691b-c40b-4b11-9e2b-d8d6d872b109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:46.173120 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254691b-c40b-4b11-9e2b-d8d6d872b109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:46.174893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254691b-c40b-4b11-9e2b-d8d6d872b109 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:46.179670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:23:46.197157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 695/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:48.243997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2304b7c-0074-4312-a4e3-0e6a37901c65 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:48.244568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2304b7c-0074-4312-a4e3-0e6a37901c65 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:48.244568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2304b7c-0074-4312-a4e3-0e6a37901c65 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:48.245924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 685/1380] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:48.251386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5804a50-7166-440f-b989-68c44ba314c9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:48.251817 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5804a50-7166-440f-b989-68c44ba314c9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:48.251968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5804a50-7166-440f-b989-68c44ba314c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:48.271105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f5804a50-7166-440f-b989-68c44ba314c9 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:48.272309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f5804a50-7166-440f-b989-68c44ba314c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:48.280770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 696/1381] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:48.327542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2304b7c-0074-4312-a4e3-0e6a37901c65 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:48.343400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2304b7c-0074-4312-a4e3-0e6a37901c65 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:48.349274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fb51d-13a3-4950-ae37-805454169546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:48.349920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fb51d-13a3-4950-ae37-805454169546 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:48.350197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fb51d-13a3-4950-ae37-805454169546 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:48.350470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fb51d-13a3-4950-ae37-805454169546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:48.361206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fb51d-13a3-4950-ae37-805454169546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:48.363008 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fb51d-13a3-4950-ae37-805454169546 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:48.373288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 686/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:50.447715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e85931-1d95-4e4e-8108-2b5a7f30e6f4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:50.448169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e85931-1d95-4e4e-8108-2b5a7f30e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:50.448250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e85931-1d95-4e4e-8108-2b5a7f30e6f4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:50.449719 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 697/1383] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:50.455289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9020bb-0b86-490d-915f-60b0625c9f9f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:50.455784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9020bb-0b86-490d-915f-60b0625c9f9f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:50.455784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9020bb-0b86-490d-915f-60b0625c9f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:50.474437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1c9020bb-0b86-490d-915f-60b0625c9f9f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:50.475612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1c9020bb-0b86-490d-915f-60b0625c9f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:50.483757 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 687/1384] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:50.531046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e85931-1d95-4e4e-8108-2b5a7f30e6f4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:50.546319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e85931-1d95-4e4e-8108-2b5a7f30e6f4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:50.552137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bcfd3-955a-49a6-af6b-b4cafb893b58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:50.552914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bcfd3-955a-49a6-af6b-b4cafb893b58 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:50.553331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bcfd3-955a-49a6-af6b-b4cafb893b58 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:50.553705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bcfd3-955a-49a6-af6b-b4cafb893b58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:50.563515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bcfd3-955a-49a6-af6b-b4cafb893b58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:50.565449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bcfd3-955a-49a6-af6b-b4cafb893b58 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:50.577026 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 698/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:52.606433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a08319-b809-4790-8954-dffa4f4694af None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:52.606973 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a08319-b809-4790-8954-dffa4f4694af None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:52.606973 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a08319-b809-4790-8954-dffa4f4694af None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:52.608233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 688/1386] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:52.613854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266c8ab-4349-495d-a663-d8d39bca86ce None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:52.614363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266c8ab-4349-495d-a663-d8d39bca86ce None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:52.614363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266c8ab-4349-495d-a663-d8d39bca86ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:52.632267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8266c8ab-4349-495d-a663-d8d39bca86ce None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:52.633472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8266c8ab-4349-495d-a663-d8d39bca86ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:52.641828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 699/1387] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:52.686570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a08319-b809-4790-8954-dffa4f4694af None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:52.706619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a08319-b809-4790-8954-dffa4f4694af None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:52.713787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d04ed-9893-496b-8cba-d82e10b34f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:52.714655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d04ed-9893-496b-8cba-d82e10b34f34 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:52.714998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d04ed-9893-496b-8cba-d82e10b34f34 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:52.715344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d04ed-9893-496b-8cba-d82e10b34f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:52.726856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d04ed-9893-496b-8cba-d82e10b34f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:52.728883 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d04ed-9893-496b-8cba-d82e10b34f34 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:52.741785 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 689/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:54.834406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa47f16-ca2c-4f89-9fe2-41c387571c2e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:54.834936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa47f16-ca2c-4f89-9fe2-41c387571c2e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:54.834936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa47f16-ca2c-4f89-9fe2-41c387571c2e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:54.836344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 700/1389] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:54.841984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb308ea-06cd-4300-8cfc-43609eac002c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:54.842420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb308ea-06cd-4300-8cfc-43609eac002c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:54.842528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb308ea-06cd-4300-8cfc-43609eac002c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:54.861397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fbb308ea-06cd-4300-8cfc-43609eac002c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:54.862667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fbb308ea-06cd-4300-8cfc-43609eac002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:54.870862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 690/1390] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:54.917817 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa47f16-ca2c-4f89-9fe2-41c387571c2e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:54.936936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa47f16-ca2c-4f89-9fe2-41c387571c2e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:54.944105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf845-d51e-4338-80d6-25d208cb8af5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:54.944760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf845-d51e-4338-80d6-25d208cb8af5 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:54.945074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf845-d51e-4338-80d6-25d208cb8af5 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:54.945385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf845-d51e-4338-80d6-25d208cb8af5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:54.954586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bf845-d51e-4338-80d6-25d208cb8af5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:54.956832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bf845-d51e-4338-80d6-25d208cb8af5 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:54.967339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 701/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:57.517153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dfef6-6674-40de-b9c0-82bef01b08c6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:57.517737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dfef6-6674-40de-b9c0-82bef01b08c6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:57.517737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dfef6-6674-40de-b9c0-82bef01b08c6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:57.519163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 691/1392] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:57.525703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f099-5ad3-4375-a37e-163133053d52 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:57.526141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f099-5ad3-4375-a37e-163133053d52 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:57.526398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f099-5ad3-4375-a37e-163133053d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:57.548149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b804f099-5ad3-4375-a37e-163133053d52 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:57.549667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b804f099-5ad3-4375-a37e-163133053d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:57.559607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 702/1393] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:57.613365 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dfef6-6674-40de-b9c0-82bef01b08c6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:57.630090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dfef6-6674-40de-b9c0-82bef01b08c6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:57.635976 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4745f6-1e00-45b8-98fb-22b2f5b5cac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:57.636647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4745f6-1e00-45b8-98fb-22b2f5b5cac6 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:57.636984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4745f6-1e00-45b8-98fb-22b2f5b5cac6 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:57.637337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4745f6-1e00-45b8-98fb-22b2f5b5cac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:57.646649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4745f6-1e00-45b8-98fb-22b2f5b5cac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:57.648298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4745f6-1e00-45b8-98fb-22b2f5b5cac6 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:57.658488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 692/1394] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:23:59.757225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16f52e-8a0d-4d8f-9cc5-2a6872df8280 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:59.757864 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16f52e-8a0d-4d8f-9cc5-2a6872df8280 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:59.757864 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16f52e-8a0d-4d8f-9cc5-2a6872df8280 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:59.759170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 703/1395] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:23:59.764795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86634d03-c7af-4c71-8080-4d54b356d3f2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:59.765261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86634d03-c7af-4c71-8080-4d54b356d3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:59.765511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86634d03-c7af-4c71-8080-4d54b356d3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:59.784012 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-86634d03-c7af-4c71-8080-4d54b356d3f2 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:23:59.785257 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-86634d03-c7af-4c71-8080-4d54b356d3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:23:59.793397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 693/1396] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:23:59.839728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16f52e-8a0d-4d8f-9cc5-2a6872df8280 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:23:59.855135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16f52e-8a0d-4d8f-9cc5-2a6872df8280 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:23:59.861391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95469d10-d3a1-4a73-b343-43678598f22c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:23:59.862034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469d10-d3a1-4a73-b343-43678598f22c service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:23:59.862312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469d10-d3a1-4a73-b343-43678598f22c service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:23:59.862580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469d10-d3a1-4a73-b343-43678598f22c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:23:59.871372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95469d10-d3a1-4a73-b343-43678598f22c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:23:59.872991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95469d10-d3a1-4a73-b343-43678598f22c service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:23:59.882578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 704/1397] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:00.107150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff90e0-2e25-4264-a872-4fc9ebb41fd0 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:00.107377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff90e0-2e25-4264-a872-4fc9ebb41fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:00.107599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff90e0-2e25-4264-a872-4fc9ebb41fd0 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:00.108973 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 694/1398] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:00.114596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5491b-ad96-48f6-ad85-9f5f140a7f16 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:00.114883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5491b-ad96-48f6-ad85-9f5f140a7f16 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:00.115158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5491b-ad96-48f6-ad85-9f5f140a7f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:00.133775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-12c5491b-ad96-48f6-ad85-9f5f140a7f16 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:00.134942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-12c5491b-ad96-48f6-ad85-9f5f140a7f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:00.143092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 705/1399] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:00.197672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e631-6634-421d-91ce-c3ce60f5744c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:00.197957 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e631-6634-421d-91ce-c3ce60f5744c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:00.198227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e631-6634-421d-91ce-c3ce60f5744c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:00.199736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 695/1400] 10.222.0.30 () {54 vars in 962 bytes} [Wed Jul 6 20:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:00.204746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948904b-c53b-4ff2-9ef2-07c28fd651bf None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:00.205174 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948904b-c53b-4ff2-9ef2-07c28fd651bf None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:00.205453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948904b-c53b-4ff2-9ef2-07c28fd651bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:00.256197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7948904b-c53b-4ff2-9ef2-07c28fd651bf None None] MFA Rules not processed for user `16f53619b6994ae0a117549a67fa29a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:00.257411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7948904b-c53b-4ff2-9ef2-07c28fd651bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:00.318744 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 706/1401] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Jul 6 20:24:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:00.326636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5e631-6634-421d-91ce-c3ce60f5744c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:00.337578 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5e631-6634-421d-91ce-c3ce60f5744c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:00.341888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f552e3f-d8c5-4925-be8c-7574d1392e78 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f53619b6994ae0a117549a67fa29a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:00.342536 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f552e3f-d8c5-4925-be8c-7574d1392e78 service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:00.342813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f552e3f-d8c5-4925-be8c-7574d1392e78 service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:00.343113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f552e3f-d8c5-4925-be8c-7574d1392e78 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:00.352490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f552e3f-d8c5-4925-be8c-7574d1392e78 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:00.353958 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f552e3f-d8c5-4925-be8c-7574d1392e78 service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:00.364597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 696/1402] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:24:01.075141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f1c0-f136-4699-b0fe-79909269a843 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:01.075643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f1c0-f136-4699-b0fe-79909269a843 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:01.075741 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f1c0-f136-4699-b0fe-79909269a843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:01.126450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3f74f1c0-f136-4699-b0fe-79909269a843 None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:01.127757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3f74f1c0-f136-4699-b0fe-79909269a843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:01.168386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:24:01.194589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 707/1403] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:24:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:01.234533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5187f52-cfc9-4fca-8f24-6cc296645872 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:01.235334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5187f52-cfc9-4fca-8f24-6cc296645872 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:01.235424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5187f52-cfc9-4fca-8f24-6cc296645872 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:01.236917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 697/1404] 10.222.0.30 () {54 vars in 942 bytes} [Wed Jul 6 20:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:01.243030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629585a1-9678-4535-bca0-1ab5e1054b4f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:01.243323 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629585a1-9678-4535-bca0-1ab5e1054b4f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:01.243605 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629585a1-9678-4535-bca0-1ab5e1054b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:01.292589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-629585a1-9678-4535-bca0-1ab5e1054b4f None None] MFA Rules not processed for user `b11e395dab424f3492f092eb3d5032dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:01.293837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-629585a1-9678-4535-bca0-1ab5e1054b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:01.365987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 708/1405] 10.222.0.30 () {58 vars in 1039 bytes} [Wed Jul 6 20:24:01 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:01.375339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5187f52-cfc9-4fca-8f24-6cc296645872 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:01.390330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5187f52-cfc9-4fca-8f24-6cc296645872 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:01.395743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972e83a-6c13-458b-816c-7f6383987700 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:01.396423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972e83a-6c13-458b-816c-7f6383987700 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:01.396713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972e83a-6c13-458b-816c-7f6383987700 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:01.397022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972e83a-6c13-458b-816c-7f6383987700 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:01.405691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972e83a-6c13-458b-816c-7f6383987700 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:01.407272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972e83a-6c13-458b-816c-7f6383987700 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:01.415511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 698/1406] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:24:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:24:01.945007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9ff73-0be4-4232-9fd2-bfd039782615 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:01.945657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9ff73-0be4-4232-9fd2-bfd039782615 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:01.945961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9ff73-0be4-4232-9fd2-bfd039782615 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:01.947373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 709/1407] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:01.952764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48252-978a-4a96-888b-caa31f2f5925 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:01.953181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48252-978a-4a96-888b-caa31f2f5925 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:01.953542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48252-978a-4a96-888b-caa31f2f5925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:01.959725 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=67 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:24:01.976071 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-deb48252-978a-4a96-888b-caa31f2f5925 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:01.977454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-deb48252-978a-4a96-888b-caa31f2f5925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:01.989014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 699/1408] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:02.029937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9ff73-0be4-4232-9fd2-bfd039782615 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:02.045269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9ff73-0be4-4232-9fd2-bfd039782615 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:02.050571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9848b4-6f7b-4116-98c4-13678ab818ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:02.051222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9848b4-6f7b-4116-98c4-13678ab818ba service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:02.051501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9848b4-6f7b-4116-98c4-13678ab818ba service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:02.051775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9848b4-6f7b-4116-98c4-13678ab818ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:02.060827 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9848b4-6f7b-4116-98c4-13678ab818ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:02.063292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9848b4-6f7b-4116-98c4-13678ab818ba service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:02.073347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 710/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:11.970246 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:24:12.069208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=59 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:24:23.621301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb89e2-185f-46a3-9891-c92e6aa5ed98 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:23.621912 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb89e2-185f-46a3-9891-c92e6aa5ed98 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:23.621912 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb89e2-185f-46a3-9891-c92e6aa5ed98 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:23.623237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 700/1410] 10.222.0.30 () {54 vars in 918 bytes} [Wed Jul 6 20:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:23.629229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c370d-3acf-4117-b059-aea44802b3f4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:23.629678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c370d-3acf-4117-b059-aea44802b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:23.629771 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c370d-3acf-4117-b059-aea44802b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:23.650428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-471c370d-3acf-4117-b059-aea44802b3f4 None None] MFA Rules not processed for user `e0df36a267464042908bbd8eebc7c40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:23.651644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-471c370d-3acf-4117-b059-aea44802b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:23.661570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 711/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Jul 6 20:24:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:23.676011 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd055-242a-4e21-af6d-09e983588866 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:23.676380 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd055-242a-4e21-af6d-09e983588866 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:23.676867 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd055-242a-4e21-af6d-09e983588866 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:23.678750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 701/1412] 10.222.0.30 () {54 vars in 918 bytes} [Wed Jul 6 20:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:23.683983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6823ce-fc48-45b7-bdf9-5243990bab66 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:23.684342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6823ce-fc48-45b7-bdf9-5243990bab66 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:23.684690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6823ce-fc48-45b7-bdf9-5243990bab66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:23.708552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0e6823ce-fc48-45b7-bdf9-5243990bab66 None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:23.709882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0e6823ce-fc48-45b7-bdf9-5243990bab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:23.719994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 712/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Jul 6 20:24:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:26.415798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952a05-8898-4466-8d10-107005831ff2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:26.416374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952a05-8898-4466-8d10-107005831ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:26.416374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952a05-8898-4466-8d10-107005831ff2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:26.417788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:26.425400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e83cb-3aba-44db-beb7-44a96f35045a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:26.426094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e83cb-3aba-44db-beb7-44a96f35045a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:26.426263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e83cb-3aba-44db-beb7-44a96f35045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:26.448923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9e6e83cb-3aba-44db-beb7-44a96f35045a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:26.450164 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9e6e83cb-3aba-44db-beb7-44a96f35045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:26.459112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:26.502671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96952a05-8898-4466-8d10-107005831ff2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:26.519082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96952a05-8898-4466-8d10-107005831ff2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:26.524892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274f984-d588-49f4-bf6e-75ea98705328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:26.525873 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274f984-d588-49f4-bf6e-75ea98705328 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:26.526377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274f984-d588-49f4-bf6e-75ea98705328 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:26.526749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274f984-d588-49f4-bf6e-75ea98705328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:26.535946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274f984-d588-49f4-bf6e-75ea98705328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:26.537542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274f984-d588-49f4-bf6e-75ea98705328 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:26.547383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 703/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:27.457525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482dcb1-fd9d-4899-adaa-a3f22797ad72 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:27.458426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482dcb1-fd9d-4899-adaa-a3f22797ad72 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:27.458426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482dcb1-fd9d-4899-adaa-a3f22797ad72 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:27.460671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:24:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:27.465857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff57a2b-8e67-4d7a-ad0c-fd41dd42df7e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:27.466321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff57a2b-8e67-4d7a-ad0c-fd41dd42df7e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:27.466432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff57a2b-8e67-4d7a-ad0c-fd41dd42df7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:27.486189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6ff57a2b-8e67-4d7a-ad0c-fd41dd42df7e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:27.487386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6ff57a2b-8e67-4d7a-ad0c-fd41dd42df7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:27.496004 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:27.647772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482dcb1-fd9d-4899-adaa-a3f22797ad72 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:27.670239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482dcb1-fd9d-4899-adaa-a3f22797ad72 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:27.676833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67e6e5-1712-4a9c-aec8-78b5b76993a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:27.677510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67e6e5-1712-4a9c-aec8-78b5b76993a9 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:27.677783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67e6e5-1712-4a9c-aec8-78b5b76993a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:27.678049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67e6e5-1712-4a9c-aec8-78b5b76993a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:27.686732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67e6e5-1712-4a9c-aec8-78b5b76993a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:27.688314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67e6e5-1712-4a9c-aec8-78b5b76993a9 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:27.698211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 715/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:28.583756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe371-1e2a-48f2-b91f-a6aac0601a6c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:28.584349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe371-1e2a-48f2-b91f-a6aac0601a6c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:28.584349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe371-1e2a-48f2-b91f-a6aac0601a6c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:28.585768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:28.591585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade075b0-a856-4624-9a47-9b58de49ef28 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:28.592142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade075b0-a856-4624-9a47-9b58de49ef28 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:28.592355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade075b0-a856-4624-9a47-9b58de49ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:28.620986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ade075b0-a856-4624-9a47-9b58de49ef28 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:28.622131 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ade075b0-a856-4624-9a47-9b58de49ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:28.631415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:28.785396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fe371-1e2a-48f2-b91f-a6aac0601a6c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:28.807910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fe371-1e2a-48f2-b91f-a6aac0601a6c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:28.814794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c073fb-b7b3-40e8-a612-ee6728156b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:28.815493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c073fb-b7b3-40e8-a612-ee6728156b24 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:28.815799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c073fb-b7b3-40e8-a612-ee6728156b24 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:28.816058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c073fb-b7b3-40e8-a612-ee6728156b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:28.824994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c073fb-b7b3-40e8-a612-ee6728156b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:28.826607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c073fb-b7b3-40e8-a612-ee6728156b24 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:28.840918 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 706/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:29.732167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7475694-9c89-4d7d-ae8b-1e5502bfb2cd None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:29.733135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7475694-9c89-4d7d-ae8b-1e5502bfb2cd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:29.733135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7475694-9c89-4d7d-ae8b-1e5502bfb2cd None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:29.734493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:29.740062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de41fbc-a3ee-4f17-b963-66359de94801 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:29.740588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de41fbc-a3ee-4f17-b963-66359de94801 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:29.740588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de41fbc-a3ee-4f17-b963-66359de94801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:29.760621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8de41fbc-a3ee-4f17-b963-66359de94801 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:29.762274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8de41fbc-a3ee-4f17-b963-66359de94801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:29.771945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:29.920774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7475694-9c89-4d7d-ae8b-1e5502bfb2cd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:29.936561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7475694-9c89-4d7d-ae8b-1e5502bfb2cd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:29.941983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8356b9-e6e5-4c73-935a-db79667f4eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:29.942629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8356b9-e6e5-4c73-935a-db79667f4eed service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:29.942912 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8356b9-e6e5-4c73-935a-db79667f4eed service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:29.943186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8356b9-e6e5-4c73-935a-db79667f4eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:29.952012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8356b9-e6e5-4c73-935a-db79667f4eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:29.953669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8356b9-e6e5-4c73-935a-db79667f4eed service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:29.964082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 718/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:30.823466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76eee-b3a2-4a43-87a7-72d43ba92b25 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:30.824055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76eee-b3a2-4a43-87a7-72d43ba92b25 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:30.824055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76eee-b3a2-4a43-87a7-72d43ba92b25 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:30.825457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:30.833012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03581b-6466-4bda-8f15-c2e665905393 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:30.833508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03581b-6466-4bda-8f15-c2e665905393 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:30.833734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03581b-6466-4bda-8f15-c2e665905393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:30.852993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8c03581b-6466-4bda-8f15-c2e665905393 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:30.854243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8c03581b-6466-4bda-8f15-c2e665905393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:30.863233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:31.010239 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb76eee-b3a2-4a43-87a7-72d43ba92b25 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:31.025631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb76eee-b3a2-4a43-87a7-72d43ba92b25 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:31.031777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fc468-a3ef-4ccb-b16a-02bc6459f61e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:31.032410 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fc468-a3ef-4ccb-b16a-02bc6459f61e service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:31.032683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fc468-a3ef-4ccb-b16a-02bc6459f61e service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:31.033022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fc468-a3ef-4ccb-b16a-02bc6459f61e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:31.041627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fc468-a3ef-4ccb-b16a-02bc6459f61e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:31.043205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fc468-a3ef-4ccb-b16a-02bc6459f61e service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:31.052435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 709/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:31.850858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433359-6d3a-4ee3-a9bd-c71a51db8a46 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:31.851365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433359-6d3a-4ee3-a9bd-c71a51db8a46 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:31.851365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433359-6d3a-4ee3-a9bd-c71a51db8a46 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:31.852794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:31.858232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93dc41-3e4a-4c6c-b0a9-ea949130963b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:31.858698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93dc41-3e4a-4c6c-b0a9-ea949130963b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:31.858800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93dc41-3e4a-4c6c-b0a9-ea949130963b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:31.877375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9d93dc41-3e4a-4c6c-b0a9-ea949130963b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:31.878558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9d93dc41-3e4a-4c6c-b0a9-ea949130963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:31.887246 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:32.041898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88433359-6d3a-4ee3-a9bd-c71a51db8a46 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:32.066480 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88433359-6d3a-4ee3-a9bd-c71a51db8a46 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:32.074847 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73361f28-a52a-4081-b5ee-2ea946336ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:32.075485 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73361f28-a52a-4081-b5ee-2ea946336ef5 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:32.075761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73361f28-a52a-4081-b5ee-2ea946336ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:32.076030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73361f28-a52a-4081-b5ee-2ea946336ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:32.084159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73361f28-a52a-4081-b5ee-2ea946336ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:32.085704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73361f28-a52a-4081-b5ee-2ea946336ef5 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:32.095649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 721/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:32.904605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40005ab-9df5-4db4-9623-2f750c5cb837 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:32.905430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40005ab-9df5-4db4-9623-2f750c5cb837 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:32.905430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40005ab-9df5-4db4-9623-2f750c5cb837 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:32.907451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:24:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:32.913279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99bbd0-77af-4b12-b9cc-645e72d1f4f6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:32.913759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99bbd0-77af-4b12-b9cc-645e72d1f4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:32.913867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99bbd0-77af-4b12-b9cc-645e72d1f4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:32.933863 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bc99bbd0-77af-4b12-b9cc-645e72d1f4f6 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:32.935063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bc99bbd0-77af-4b12-b9cc-645e72d1f4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:32.943701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:33.094729 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40005ab-9df5-4db4-9623-2f750c5cb837 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:33.118320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40005ab-9df5-4db4-9623-2f750c5cb837 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:33.131681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02de6a1-76cd-4e9e-a6ee-c5300ea79c14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:33.133223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02de6a1-76cd-4e9e-a6ee-c5300ea79c14 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:33.133705 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02de6a1-76cd-4e9e-a6ee-c5300ea79c14 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:33.134101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02de6a1-76cd-4e9e-a6ee-c5300ea79c14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:33.146822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02de6a1-76cd-4e9e-a6ee-c5300ea79c14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:33.148634 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02de6a1-76cd-4e9e-a6ee-c5300ea79c14 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:33.159111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 712/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:33.960083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444148-4974-4960-937f-8aee71271e55 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:33.960942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444148-4974-4960-937f-8aee71271e55 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:33.960942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444148-4974-4960-937f-8aee71271e55 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:33.963276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:24:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:33.969338 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154858c-525d-42b2-9943-f98ad9006919 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:33.970068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154858c-525d-42b2-9943-f98ad9006919 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:33.970170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154858c-525d-42b2-9943-f98ad9006919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:33.997317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b154858c-525d-42b2-9943-f98ad9006919 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:33.998519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b154858c-525d-42b2-9943-f98ad9006919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:34.006880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:34.163766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa444148-4974-4960-937f-8aee71271e55 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:34.180815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa444148-4974-4960-937f-8aee71271e55 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:34.186453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793589d-89c8-4ba2-94cd-8b050950bfe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:34.187104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793589d-89c8-4ba2-94cd-8b050950bfe6 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:34.187384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793589d-89c8-4ba2-94cd-8b050950bfe6 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:34.187662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793589d-89c8-4ba2-94cd-8b050950bfe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:34.195839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793589d-89c8-4ba2-94cd-8b050950bfe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:34.197498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793589d-89c8-4ba2-94cd-8b050950bfe6 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:34.207388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 724/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:35.000923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33edb9-88b9-472f-970d-1f0ab9c8b205 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:35.001428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33edb9-88b9-472f-970d-1f0ab9c8b205 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:35.001524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33edb9-88b9-472f-970d-1f0ab9c8b205 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:35.003796 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:24:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:35.008813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09a32-6f5f-48bf-9385-098e82ef1c5c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:35.009280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09a32-6f5f-48bf-9385-098e82ef1c5c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:35.009397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09a32-6f5f-48bf-9385-098e82ef1c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:35.028260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a6c09a32-6f5f-48bf-9385-098e82ef1c5c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:35.029460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a6c09a32-6f5f-48bf-9385-098e82ef1c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:35.038381 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:35.205905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33edb9-88b9-472f-970d-1f0ab9c8b205 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:35.230675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33edb9-88b9-472f-970d-1f0ab9c8b205 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:35.237376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18343f2b-3eb9-4ff2-bf7f-efcf3446304f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:35.238047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18343f2b-3eb9-4ff2-bf7f-efcf3446304f service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:35.238303 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18343f2b-3eb9-4ff2-bf7f-efcf3446304f service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:35.238572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18343f2b-3eb9-4ff2-bf7f-efcf3446304f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:35.247280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18343f2b-3eb9-4ff2-bf7f-efcf3446304f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:35.248862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18343f2b-3eb9-4ff2-bf7f-efcf3446304f service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:35.258703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 715/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:37.194250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85f3b0-0b2c-48bb-9be4-95a0a68518f8 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:37.194793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85f3b0-0b2c-48bb-9be4-95a0a68518f8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:37.194793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85f3b0-0b2c-48bb-9be4-95a0a68518f8 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:37.196105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:37.202745 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634e888-b883-4fac-a6a3-fb060ede1250 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:37.203498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634e888-b883-4fac-a6a3-fb060ede1250 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:37.203690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634e888-b883-4fac-a6a3-fb060ede1250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:37.232480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6634e888-b883-4fac-a6a3-fb060ede1250 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:37.234014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6634e888-b883-4fac-a6a3-fb060ede1250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:37.243474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:37.284883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85f3b0-0b2c-48bb-9be4-95a0a68518f8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:37.297323 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85f3b0-0b2c-48bb-9be4-95a0a68518f8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:37.301085 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f67f2c-e67d-4a8a-ae85-a241765fbe6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:37.301717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f67f2c-e67d-4a8a-ae85-a241765fbe6b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:37.301996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f67f2c-e67d-4a8a-ae85-a241765fbe6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:37.302265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f67f2c-e67d-4a8a-ae85-a241765fbe6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:37.311799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f67f2c-e67d-4a8a-ae85-a241765fbe6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:37.313240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f67f2c-e67d-4a8a-ae85-a241765fbe6b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:37.323102 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 727/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:39.510828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777502c-4fc2-41f4-b725-829d8979aa99 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:39.511427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777502c-4fc2-41f4-b725-829d8979aa99 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:39.511427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777502c-4fc2-41f4-b725-829d8979aa99 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:39.513727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:24:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:39.519209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767c2e-1725-46cd-88a4-f64980c05c25 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:39.519690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767c2e-1725-46cd-88a4-f64980c05c25 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:39.519690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767c2e-1725-46cd-88a4-f64980c05c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:39.539212 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-db767c2e-1725-46cd-88a4-f64980c05c25 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:39.540384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-db767c2e-1725-46cd-88a4-f64980c05c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:39.548670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:39.586839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777502c-4fc2-41f4-b725-829d8979aa99 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:39.589654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f777502c-4fc2-41f4-b725-829d8979aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:39.610198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777502c-4fc2-41f4-b725-829d8979aa99 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:39.614844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2409d77-f68c-404f-ac8c-404c05924a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:39.615518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2409d77-f68c-404f-ac8c-404c05924a12 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:39.615810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2409d77-f68c-404f-ac8c-404c05924a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:39.616123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2409d77-f68c-404f-ac8c-404c05924a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:39.625377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2409d77-f68c-404f-ac8c-404c05924a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:39.626847 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2409d77-f68c-404f-ac8c-404c05924a12 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:39.636842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 718/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:42.009046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab0fa8-bc08-48db-bf73-1538cff20010 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:42.009527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab0fa8-bc08-48db-bf73-1538cff20010 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:42.009766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab0fa8-bc08-48db-bf73-1538cff20010 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:42.011308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:42.016941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dc9d1-ded5-4af9-a6bd-78803eaa7c14 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:42.017407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dc9d1-ded5-4af9-a6bd-78803eaa7c14 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:42.017527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dc9d1-ded5-4af9-a6bd-78803eaa7c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:42.036284 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-693dc9d1-ded5-4af9-a6bd-78803eaa7c14 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:42.037544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-693dc9d1-ded5-4af9-a6bd-78803eaa7c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:42.050136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:24:42.090952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab0fa8-bc08-48db-bf73-1538cff20010 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:42.102955 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab0fa8-bc08-48db-bf73-1538cff20010 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:42.106868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18cd18-b185-4f13-8f03-0a5e813ad01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:42.107511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18cd18-b185-4f13-8f03-0a5e813ad01d service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:42.107799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18cd18-b185-4f13-8f03-0a5e813ad01d service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:42.108073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18cd18-b185-4f13-8f03-0a5e813ad01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:42.117742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18cd18-b185-4f13-8f03-0a5e813ad01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:42.119196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18cd18-b185-4f13-8f03-0a5e813ad01d service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:42.128685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 730/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:44.276008 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917c245-23b0-4a9d-8843-1b06dd5eba4f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:44.276666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917c245-23b0-4a9d-8843-1b06dd5eba4f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:44.276666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917c245-23b0-4a9d-8843-1b06dd5eba4f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:44.278009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:44.284554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df1d81-3cc1-4db7-af18-a7cfce6dce3f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:44.285332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df1d81-3cc1-4db7-af18-a7cfce6dce3f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:44.285513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df1d81-3cc1-4db7-af18-a7cfce6dce3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:44.312441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-61df1d81-3cc1-4db7-af18-a7cfce6dce3f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:44.313688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-61df1d81-3cc1-4db7-af18-a7cfce6dce3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:44.322221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:44.360561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917c245-23b0-4a9d-8843-1b06dd5eba4f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:44.372568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917c245-23b0-4a9d-8843-1b06dd5eba4f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:44.376367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83bf79-4772-46f7-827d-5dfa1e11154a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:44.377114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83bf79-4772-46f7-827d-5dfa1e11154a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:44.377414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83bf79-4772-46f7-827d-5dfa1e11154a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:44.377691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83bf79-4772-46f7-827d-5dfa1e11154a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:44.387840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83bf79-4772-46f7-827d-5dfa1e11154a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:44.389318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83bf79-4772-46f7-827d-5dfa1e11154a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:44.399100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 721/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:46.583773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b19d8-335f-407d-912c-0a6d91cae4e6 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:46.584389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b19d8-335f-407d-912c-0a6d91cae4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:46.584389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b19d8-335f-407d-912c-0a6d91cae4e6 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:46.585909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:24:46.592275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebd8fc-dcd7-4a67-8b1c-ecf2e8f8157a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:46.592702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebd8fc-dcd7-4a67-8b1c-ecf2e8f8157a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:46.592825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebd8fc-dcd7-4a67-8b1c-ecf2e8f8157a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:46.613935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d1ebd8fc-dcd7-4a67-8b1c-ecf2e8f8157a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:46.615209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d1ebd8fc-dcd7-4a67-8b1c-ecf2e8f8157a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:46.623856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:46.666917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b19d8-335f-407d-912c-0a6d91cae4e6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:46.680006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b19d8-335f-407d-912c-0a6d91cae4e6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:46.685189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78829734-5cbf-46ce-a0fd-1d66d19cb642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:46.686609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829734-5cbf-46ce-a0fd-1d66d19cb642 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:46.686609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829734-5cbf-46ce-a0fd-1d66d19cb642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:46.686920 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829734-5cbf-46ce-a0fd-1d66d19cb642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:46.699457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78829734-5cbf-46ce-a0fd-1d66d19cb642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:46.700885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78829734-5cbf-46ce-a0fd-1d66d19cb642 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:46.711626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 733/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:24:48.790016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9128-6295-4d75-9fd4-5c477fbb53e1 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:48.790933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9128-6295-4d75-9fd4-5c477fbb53e1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:48.790933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9128-6295-4d75-9fd4-5c477fbb53e1 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:48.793208 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:24:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:48.801243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170a780-6458-4747-8872-36dea83795f6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:48.801671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170a780-6458-4747-8872-36dea83795f6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:48.801790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170a780-6458-4747-8872-36dea83795f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:48.821696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3170a780-6458-4747-8872-36dea83795f6 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:48.822972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3170a780-6458-4747-8872-36dea83795f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:48.832547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:24:48.871256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c9128-6295-4d75-9fd4-5c477fbb53e1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:48.884997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c9128-6295-4d75-9fd4-5c477fbb53e1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:48.889979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4bccc-3b94-48b8-b750-bcde49b58183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:48.890628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4bccc-3b94-48b8-b750-bcde49b58183 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:48.890912 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4bccc-3b94-48b8-b750-bcde49b58183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:48.891186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4bccc-3b94-48b8-b750-bcde49b58183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:48.901369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4bccc-3b94-48b8-b750-bcde49b58183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:48.902861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4bccc-3b94-48b8-b750-bcde49b58183 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:48.912914 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 724/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:50.973612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda255c-acd9-405f-a0fd-f1709a95cf7c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:50.974540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda255c-acd9-405f-a0fd-f1709a95cf7c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:50.974540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda255c-acd9-405f-a0fd-f1709a95cf7c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:50.976813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:24:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:50.983602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee9f5-70b8-4a50-b12c-42cb8ba55821 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:50.984045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee9f5-70b8-4a50-b12c-42cb8ba55821 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:50.984140 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee9f5-70b8-4a50-b12c-42cb8ba55821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:51.003378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8d9ee9f5-70b8-4a50-b12c-42cb8ba55821 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:51.004577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8d9ee9f5-70b8-4a50-b12c-42cb8ba55821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:51.014224 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:51.053606 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda255c-acd9-405f-a0fd-f1709a95cf7c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:51.065498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda255c-acd9-405f-a0fd-f1709a95cf7c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:51.070110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd5184-980b-443f-b1e1-e76cbf504975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:51.070751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd5184-980b-443f-b1e1-e76cbf504975 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:51.071029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd5184-980b-443f-b1e1-e76cbf504975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:51.071293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd5184-980b-443f-b1e1-e76cbf504975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:51.082396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd5184-980b-443f-b1e1-e76cbf504975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:51.083787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd5184-980b-443f-b1e1-e76cbf504975 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:51.094112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 736/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:53.155551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f271-2119-4182-898a-921cad8379f4 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:53.156394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f271-2119-4182-898a-921cad8379f4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:53.156394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f271-2119-4182-898a-921cad8379f4 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:53.158472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:24:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:53.167123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf0a33-7feb-40fb-8a51-4f6331af3987 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:53.167596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf0a33-7feb-40fb-8a51-4f6331af3987 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:53.167802 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf0a33-7feb-40fb-8a51-4f6331af3987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:53.174546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=79 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:24:53.187877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-efdf0a33-7feb-40fb-8a51-4f6331af3987 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:53.189152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-efdf0a33-7feb-40fb-8a51-4f6331af3987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:53.197180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:53.238943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2f271-2119-4182-898a-921cad8379f4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:53.247997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=73 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:24:53.255507 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2f271-2119-4182-898a-921cad8379f4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:53.259616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da8e4-1ada-47c0-a527-1b9751c80204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:53.260297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da8e4-1ada-47c0-a527-1b9751c80204 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:53.260580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da8e4-1ada-47c0-a527-1b9751c80204 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:53.260855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da8e4-1ada-47c0-a527-1b9751c80204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:53.270510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62da8e4-1ada-47c0-a527-1b9751c80204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:53.272008 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62da8e4-1ada-47c0-a527-1b9751c80204 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:53.282169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 727/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:55.347599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b2215-a01b-46db-8661-9894e881f89b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:55.348196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b2215-a01b-46db-8661-9894e881f89b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:55.348196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b2215-a01b-46db-8661-9894e881f89b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:55.349594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:55.355160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7af93-0090-4218-89bd-87a1b8687897 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:55.355712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7af93-0090-4218-89bd-87a1b8687897 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:55.355838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7af93-0090-4218-89bd-87a1b8687897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:55.374676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-dac7af93-0090-4218-89bd-87a1b8687897 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:55.375863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dac7af93-0090-4218-89bd-87a1b8687897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:55.384202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:55.420127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b2215-a01b-46db-8661-9894e881f89b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:55.432739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b2215-a01b-46db-8661-9894e881f89b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:55.436701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a66c6a-9026-4aa2-9559-f91b625255ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:55.437394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a66c6a-9026-4aa2-9559-f91b625255ae service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:55.437664 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a66c6a-9026-4aa2-9559-f91b625255ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:55.437929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a66c6a-9026-4aa2-9559-f91b625255ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:55.447542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a66c6a-9026-4aa2-9559-f91b625255ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:55.448979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a66c6a-9026-4aa2-9559-f91b625255ae service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:55.458934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 739/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:24:57.471265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9e75-0019-4410-9300-3384fd2e7fa2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:57.472197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9e75-0019-4410-9300-3384fd2e7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:57.472197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9e75-0019-4410-9300-3384fd2e7fa2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:57.474366 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:24:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:24:57.482467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6586-4ca7-440b-a52c-0a4d552bf9e2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:57.482881 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6586-4ca7-440b-a52c-0a4d552bf9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:57.483016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6586-4ca7-440b-a52c-0a4d552bf9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:57.502353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3afd6586-4ca7-440b-a52c-0a4d552bf9e2 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:24:57.503583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3afd6586-4ca7-440b-a52c-0a4d552bf9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:24:57.513274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:24:57.550424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f9e75-0019-4410-9300-3384fd2e7fa2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:24:57.563570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f9e75-0019-4410-9300-3384fd2e7fa2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:24:57.569809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b1499-611a-4371-b8b0-167387dbff7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:24:57.571264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b1499-611a-4371-b8b0-167387dbff7f service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:24:57.571638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b1499-611a-4371-b8b0-167387dbff7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:24:57.572075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b1499-611a-4371-b8b0-167387dbff7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:24:57.583000 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b1499-611a-4371-b8b0-167387dbff7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:24:57.584427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b1499-611a-4371-b8b0-167387dbff7f service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:24:57.594107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 730/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:25:07.496982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=11 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:25:07.589735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=14 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:25:17.092389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea4b8-6cbe-4984-be3f-1ce3df87a6f3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:17.093298 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea4b8-6cbe-4984-be3f-1ce3df87a6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:17.093298 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea4b8-6cbe-4984-be3f-1ce3df87a6f3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:17.095392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 741/1471] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:25:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:25:17.104239 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8b340-670a-407f-a823-b252d399efd5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:17.105013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8b340-670a-407f-a823-b252d399efd5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:17.105190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8b340-670a-407f-a823-b252d399efd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:17.125513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f3d8b340-670a-407f-a823-b252d399efd5 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:25:17.126797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f3d8b340-670a-407f-a823-b252d399efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:25:17.135269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 731/1472] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:25:17.220569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb998df-7934-403a-b7d1-2dc4ebce3e7c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:17.220931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb998df-7934-403a-b7d1-2dc4ebce3e7c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:17.221338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb998df-7934-403a-b7d1-2dc4ebce3e7c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:17.223386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 742/1473] 10.222.0.30 () {54 vars in 962 bytes} [Wed Jul 6 20:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:25:17.228223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57495f-d36b-4af9-8d3f-23e2585476c1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:17.228513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57495f-d36b-4af9-8d3f-23e2585476c1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:17.228787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57495f-d36b-4af9-8d3f-23e2585476c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:17.248426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ad57495f-d36b-4af9-8d3f-23e2585476c1 None None] MFA Rules not processed for user `16f53619b6994ae0a117549a67fa29a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:25:17.249650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ad57495f-d36b-4af9-8d3f-23e2585476c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:25:17.256574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 732/1474] 10.222.0.30 () {58 vars in 1059 bytes} [Wed Jul 6 20:25:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:25:17.263642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb998df-7934-403a-b7d1-2dc4ebce3e7c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:25:17.275068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb998df-7934-403a-b7d1-2dc4ebce3e7c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:25:17.278771 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda73fa-0ba3-48b4-b065-9b7c296c8b89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f53619b6994ae0a117549a67fa29a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:25:17.279428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda73fa-0ba3-48b4-b065-9b7c296c8b89 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:17.279707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda73fa-0ba3-48b4-b065-9b7c296c8b89 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:17.279976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda73fa-0ba3-48b4-b065-9b7c296c8b89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:17.288907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda73fa-0ba3-48b4-b065-9b7c296c8b89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:25:17.290352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda73fa-0ba3-48b4-b065-9b7c296c8b89 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:25:17.299573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 743/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:25:19.374548 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4900300-c3f0-473d-b92a-c52580c59401 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:19.375406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4900300-c3f0-473d-b92a-c52580c59401 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:19.375406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4900300-c3f0-473d-b92a-c52580c59401 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:19.378803 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 733/1476] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:25:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:25:19.383956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c9cdf-54db-4d08-9f44-fef8d5253f91 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:19.384471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c9cdf-54db-4d08-9f44-fef8d5253f91 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:19.384471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c9cdf-54db-4d08-9f44-fef8d5253f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:19.403063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ae4c9cdf-54db-4d08-9f44-fef8d5253f91 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:25:19.404270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ae4c9cdf-54db-4d08-9f44-fef8d5253f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:25:19.412602 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 744/1477] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:25:19.436153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4900300-c3f0-473d-b92a-c52580c59401 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:25:19.453058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4900300-c3f0-473d-b92a-c52580c59401 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:25:19.459356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930e412-8bc7-4246-9b42-78393aabd85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:25:19.460039 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930e412-8bc7-4246-9b42-78393aabd85c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:19.460319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930e412-8bc7-4246-9b42-78393aabd85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:19.460592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930e412-8bc7-4246-9b42-78393aabd85c admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:19.461407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930e412-8bc7-4246-9b42-78393aabd85c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:25:19.463280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-5930e412-8bc7-4246-9b42-78393aabd85c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:25:19.463280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: warnings.warn(msg) Jul 06 20:25:19.463280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: Jul 06 20:25:19.464418 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930e412-8bc7-4246-9b42-78393aabd85c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:25:19.483777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 734/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Wed Jul 6 20:25:19 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:25:21.519943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fe7c6-e302-4dc4-a781-781a1a29d5e9 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:21.520535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fe7c6-e302-4dc4-a781-781a1a29d5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:21.520535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fe7c6-e302-4dc4-a781-781a1a29d5e9 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:21.522191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 745/1479] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:25:21.528249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9a173-c95d-4cb3-8994-0b42e8d92e13 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:21.529018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9a173-c95d-4cb3-8994-0b42e8d92e13 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:21.529167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9a173-c95d-4cb3-8994-0b42e8d92e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:21.552729 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0eb9a173-c95d-4cb3-8994-0b42e8d92e13 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:25:21.553959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0eb9a173-c95d-4cb3-8994-0b42e8d92e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:25:21.562470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 735/1480] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:25:21.605622 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fe7c6-e302-4dc4-a781-781a1a29d5e9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:25:21.621075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fe7c6-e302-4dc4-a781-781a1a29d5e9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:25:21.626585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9601a-3d8c-47be-a363-401641ba86d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:25:21.627282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9601a-3d8c-47be-a363-401641ba86d3 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:21.627602 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9601a-3d8c-47be-a363-401641ba86d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:21.627920 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9601a-3d8c-47be-a363-401641ba86d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:21.636361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9601a-3d8c-47be-a363-401641ba86d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:25:21.637967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9601a-3d8c-47be-a363-401641ba86d3 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:25:21.647329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 746/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:25:23.882736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7fd1f-c86a-44fe-b636-c73af1193719 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:23.883575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7fd1f-c86a-44fe-b636-c73af1193719 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:23.883575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7fd1f-c86a-44fe-b636-c73af1193719 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:23.885854 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 736/1482] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:25:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:25:23.892565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98a86-b5ef-4b29-96b4-406969c8f923 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:23.892995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98a86-b5ef-4b29-96b4-406969c8f923 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:23.893132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98a86-b5ef-4b29-96b4-406969c8f923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:23.912129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cfe98a86-b5ef-4b29-96b4-406969c8f923 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:25:23.913354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cfe98a86-b5ef-4b29-96b4-406969c8f923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:25:23.923065 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 747/1483] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:25:23.959480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7fd1f-c86a-44fe-b636-c73af1193719 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:25:23.974294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7fd1f-c86a-44fe-b636-c73af1193719 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:25:23.978719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6623f-e4f4-4ee2-8498-e1e498e45f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:25:23.979363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6623f-e4f4-4ee2-8498-e1e498e45f5b service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:23.979652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6623f-e4f4-4ee2-8498-e1e498e45f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:23.979924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6623f-e4f4-4ee2-8498-e1e498e45f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:23.989771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6623f-e4f4-4ee2-8498-e1e498e45f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:25:23.991206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6623f-e4f4-4ee2-8498-e1e498e45f5b service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:25:24.000876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 737/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:25:26.082416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7bad7-76c6-49d7-a53c-d1b4c68bd822 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:26.082969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7bad7-76c6-49d7-a53c-d1b4c68bd822 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:26.082969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7bad7-76c6-49d7-a53c-d1b4c68bd822 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:26.084253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 748/1485] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:25:26.091595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a1a01-c7cb-406c-a45a-f9124cd20d99 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:26.092304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a1a01-c7cb-406c-a45a-f9124cd20d99 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:26.092494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a1a01-c7cb-406c-a45a-f9124cd20d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:26.118015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-107a1a01-c7cb-406c-a45a-f9124cd20d99 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:25:26.119260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-107a1a01-c7cb-406c-a45a-f9124cd20d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:25:26.128429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 738/1486] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:25:26.169427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7bad7-76c6-49d7-a53c-d1b4c68bd822 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:25:26.181086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7bad7-76c6-49d7-a53c-d1b4c68bd822 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:25:26.184770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90184947-72ae-406a-b202-f0dd431dc5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:25:26.185445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184947-72ae-406a-b202-f0dd431dc5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:26.185764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184947-72ae-406a-b202-f0dd431dc5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:26.186034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184947-72ae-406a-b202-f0dd431dc5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:26.195238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90184947-72ae-406a-b202-f0dd431dc5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:25:26.196675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90184947-72ae-406a-b202-f0dd431dc5d0 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:25:26.206304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 749/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:25:28.291349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b12e7-5f45-4394-ae5c-9a9a5b71f888 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:28.291937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b12e7-5f45-4394-ae5c-9a9a5b71f888 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:28.291937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b12e7-5f45-4394-ae5c-9a9a5b71f888 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:28.294113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 739/1488] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:25:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:25:28.303006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7227dd8-fe18-4e5e-85cb-207b0f72fc71 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:28.303429 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7227dd8-fe18-4e5e-85cb-207b0f72fc71 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:28.303571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7227dd8-fe18-4e5e-85cb-207b0f72fc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:28.331515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f7227dd8-fe18-4e5e-85cb-207b0f72fc71 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:25:28.332714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f7227dd8-fe18-4e5e-85cb-207b0f72fc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:25:28.341916 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 750/1489] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:25:28.382476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b12e7-5f45-4394-ae5c-9a9a5b71f888 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:25:28.393799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b12e7-5f45-4394-ae5c-9a9a5b71f888 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:25:28.397817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bdb0e-8bae-4651-b0eb-2fa22d20f119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:25:28.398787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bdb0e-8bae-4651-b0eb-2fa22d20f119 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:28.399061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bdb0e-8bae-4651-b0eb-2fa22d20f119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:28.399302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bdb0e-8bae-4651-b0eb-2fa22d20f119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:28.408654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bdb0e-8bae-4651-b0eb-2fa22d20f119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:25:28.410106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bdb0e-8bae-4651-b0eb-2fa22d20f119 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:25:28.419389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 740/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:25:30.610151 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060cdf-9065-415b-9ed8-8d6188fac350 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:30.610882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060cdf-9065-415b-9ed8-8d6188fac350 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:30.610882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060cdf-9065-415b-9ed8-8d6188fac350 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:30.612099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 751/1491] 10.222.0.30 () {54 vars in 926 bytes} [Wed Jul 6 20:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:25:30.619054 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778049e1-b238-4732-bd75-7582f2edd276 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:30.619860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778049e1-b238-4732-bd75-7582f2edd276 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:30.620025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778049e1-b238-4732-bd75-7582f2edd276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:30.645272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-778049e1-b238-4732-bd75-7582f2edd276 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:25:30.646496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-778049e1-b238-4732-bd75-7582f2edd276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:25:30.655083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 741/1492] 10.222.0.30 () {58 vars in 1023 bytes} [Wed Jul 6 20:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:25:30.694186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5060cdf-9065-415b-9ed8-8d6188fac350 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:25:30.706590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5060cdf-9065-415b-9ed8-8d6188fac350 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:25:30.711112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c591c5-e624-4be9-90f9-d36184275e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:25:30.711799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c591c5-e624-4be9-90f9-d36184275e58 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:25:30.712076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c591c5-e624-4be9-90f9-d36184275e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:25:30.712343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c591c5-e624-4be9-90f9-d36184275e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:25:30.722002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c591c5-e624-4be9-90f9-d36184275e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:25:30.723427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c591c5-e624-4be9-90f9-d36184275e58 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:25:30.733171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 752/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:25:40.640005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=33 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:25:40.728608 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=33 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:04.713638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a032b-b832-4f72-b680-17cc295f7d17 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:04.714646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a032b-b832-4f72-b680-17cc295f7d17 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:04.714646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a032b-b832-4f72-b680-17cc295f7d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:04.741850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-962a032b-b832-4f72-b680-17cc295f7d17 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:04.743362 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-962a032b-b832-4f72-b680-17cc295f7d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:04.752557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 742/1494] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:27:04.760687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690682-679d-4c48-8586-2cc236f5f87a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:04.761247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690682-679d-4c48-8586-2cc236f5f87a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:04.761247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690682-679d-4c48-8586-2cc236f5f87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:04.781361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f5690682-679d-4c48-8586-2cc236f5f87a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:04.782556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f5690682-679d-4c48-8586-2cc236f5f87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:04.792487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 753/1495] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:27:04.797112 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a032b-b832-4f72-b680-17cc295f7d17 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:04.807604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a032b-b832-4f72-b680-17cc295f7d17 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:04.813296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb9d0a-f09f-4155-a0ab-f5b683f10d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:04.813961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb9d0a-f09f-4155-a0ab-f5b683f10d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:04.814239 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb9d0a-f09f-4155-a0ab-f5b683f10d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:04.814506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb9d0a-f09f-4155-a0ab-f5b683f10d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:04.815240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb9d0a-f09f-4155-a0ab-f5b683f10d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:04.815517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb9d0a-f09f-4155-a0ab-f5b683f10d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:04.816608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-4bfb9d0a-f09f-4155-a0ab-f5b683f10d26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:27:04.816608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: warnings.warn(msg) Jul 06 20:27:04.816608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: Jul 06 20:27:04.817555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb9d0a-f09f-4155-a0ab-f5b683f10d26 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:04.829848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 743/1496] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:04.838307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5690682-679d-4c48-8586-2cc236f5f87a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:04.848266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5690682-679d-4c48-8586-2cc236f5f87a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:04.853852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860d964-687e-4a05-b251-bc49b6eccac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:04.854500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860d964-687e-4a05-b251-bc49b6eccac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:04.854778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860d964-687e-4a05-b251-bc49b6eccac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:04.855033 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860d964-687e-4a05-b251-bc49b6eccac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:04.855728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860d964-687e-4a05-b251-bc49b6eccac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:04.857554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: WARNING py.warnings [None req-5860d964-687e-4a05-b251-bc49b6eccac6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:27:04.857554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: warnings.warn(msg) Jul 06 20:27:04.857554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: Jul 06 20:27:04.858774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860d964-687e-4a05-b251-bc49b6eccac6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:04.898953 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 754/1497] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:27:04 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:27:04.903240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb9d0a-f09f-4155-a0ab-f5b683f10d26 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:04.913397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb9d0a-f09f-4155-a0ab-f5b683f10d26 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:04.971884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cd197-ec56-432d-8d48-6fceef1ba855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:04.972439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cd197-ec56-432d-8d48-6fceef1ba855 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:04.972719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cd197-ec56-432d-8d48-6fceef1ba855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:04.973029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cd197-ec56-432d-8d48-6fceef1ba855 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:04.973716 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cd197-ec56-432d-8d48-6fceef1ba855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:04.974727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-d55cd197-ec56-432d-8d48-6fceef1ba855 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:27:04.974727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: warnings.warn(msg) Jul 06 20:27:04.974727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: Jul 06 20:27:04.975924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cd197-ec56-432d-8d48-6fceef1ba855 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:04.997923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 744/1498] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:27:04 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:27:05.002057 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860d964-687e-4a05-b251-bc49b6eccac6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:05.014964 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860d964-687e-4a05-b251-bc49b6eccac6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:05.020437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfa7a5-de96-498d-9161-b27afd60a882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:05.021137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfa7a5-de96-498d-9161-b27afd60a882 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:05.021416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfa7a5-de96-498d-9161-b27afd60a882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:05.021684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfa7a5-de96-498d-9161-b27afd60a882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:05.022399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfa7a5-de96-498d-9161-b27afd60a882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:05.023412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: WARNING py.warnings [None req-36dfa7a5-de96-498d-9161-b27afd60a882 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:27:05.023412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: warnings.warn(msg) Jul 06 20:27:05.023412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: Jul 06 20:27:05.024310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfa7a5-de96-498d-9161-b27afd60a882 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:05.038467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 755/1499] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:27:05.042743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cd197-ec56-432d-8d48-6fceef1ba855 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:05.053399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cd197-ec56-432d-8d48-6fceef1ba855 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:05.059043 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18bf6c-32e1-45f9-b9cd-75c40f4e2b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:05.059728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18bf6c-32e1-45f9-b9cd-75c40f4e2b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:05.060028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18bf6c-32e1-45f9-b9cd-75c40f4e2b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:05.060297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18bf6c-32e1-45f9-b9cd-75c40f4e2b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:05.061060 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18bf6c-32e1-45f9-b9cd-75c40f4e2b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:05.062056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-ba18bf6c-32e1-45f9-b9cd-75c40f4e2b06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:27:05.062056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: warnings.warn(msg) Jul 06 20:27:05.062056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: Jul 06 20:27:05.063001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18bf6c-32e1-45f9-b9cd-75c40f4e2b06 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:05.076553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 745/1500] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:27:05.080754 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfa7a5-de96-498d-9161-b27afd60a882 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:05.090782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfa7a5-de96-498d-9161-b27afd60a882 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:05.095589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803cfc7-f026-477a-962f-277b4eab8cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:05.096598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803cfc7-f026-477a-962f-277b4eab8cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:05.096874 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803cfc7-f026-477a-962f-277b4eab8cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:05.097175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803cfc7-f026-477a-962f-277b4eab8cd1 admin admin] PATH_INFO: `/v3/projects/9b6411c3d6834ae7a904f1b77e06f3e2/users/26e6580f10ef4f3da93f35a0f226cc81/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:05.112256 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803cfc7-f026-477a-962f-277b4eab8cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6411c3d6834ae7a904f1b77e06f3e2, user_id=26e6580f10ef4f3da93f35a0f226cc81, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:05.113309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: WARNING py.warnings [None req-e803cfc7-f026-477a-962f-277b4eab8cd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:27:05.113309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: warnings.warn(msg) Jul 06 20:27:05.113309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: Jul 06 20:27:05.115215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803cfc7-f026-477a-962f-277b4eab8cd1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:05.130515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 756/1501] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:27:05 2022] PUT /identity/v3/projects/9b6411c3d6834ae7a904f1b77e06f3e2/users/26e6580f10ef4f3da93f35a0f226cc81/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:27:05.142818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aaeb5-4648-4ce0-94cb-a80646a1c4df None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:05.143095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aaeb5-4648-4ce0-94cb-a80646a1c4df None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:05.143336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aaeb5-4648-4ce0-94cb-a80646a1c4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:05.170072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f98aaeb5-4648-4ce0-94cb-a80646a1c4df None None] MFA Rules not processed for user `26e6580f10ef4f3da93f35a0f226cc81`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:05.171270 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f98aaeb5-4648-4ce0-94cb-a80646a1c4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:05.236861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 746/1502] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:27:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:27:05.250660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a5dc1-186b-4caa-800e-83cd3e612b50 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:05.250941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a5dc1-186b-4caa-800e-83cd3e612b50 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:05.251221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a5dc1-186b-4caa-800e-83cd3e612b50 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:05.252628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 757/1503] 10.222.0.30 () {54 vars in 963 bytes} [Wed Jul 6 20:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:05.257621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4896a4-243b-4b6b-b087-37e758e4467f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:05.257936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4896a4-243b-4b6b-b087-37e758e4467f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:05.258217 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4896a4-243b-4b6b-b087-37e758e4467f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:05.277277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2e4896a4-243b-4b6b-b087-37e758e4467f None None] MFA Rules not processed for user `344585d4cf44449e8b040d635fe45c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:05.278478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2e4896a4-243b-4b6b-b087-37e758e4467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:05.323278 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:05.334914 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 747/1504] 10.222.0.30 () {58 vars in 1060 bytes} [Wed Jul 6 20:27:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:27:05.343370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a5dc1-186b-4caa-800e-83cd3e612b50 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:05.354200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a5dc1-186b-4caa-800e-83cd3e612b50 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:05.357829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e716e-389f-4b8f-bd1e-ec30e06fdc17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:05.358492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e716e-389f-4b8f-bd1e-ec30e06fdc17 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:05.358772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e716e-389f-4b8f-bd1e-ec30e06fdc17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:05.359039 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e716e-389f-4b8f-bd1e-ec30e06fdc17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:05.368797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e716e-389f-4b8f-bd1e-ec30e06fdc17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:05.370803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e716e-389f-4b8f-bd1e-ec30e06fdc17 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:05.381373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 758/1505] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:27:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:27:05.433396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb8d3-833a-4ae5-8d7e-e588a8ef2df4 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:05.433687 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb8d3-833a-4ae5-8d7e-e588a8ef2df4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:05.433965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb8d3-833a-4ae5-8d7e-e588a8ef2df4 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:05.435296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 748/1506] 10.222.0.30 () {52 vars in 829 bytes} [Wed Jul 6 20:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:05.439292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e716e-389f-4b8f-bd1e-ec30e06fdc17 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:05.504293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e716e-389f-4b8f-bd1e-ec30e06fdc17 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:05.509564 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:05.510434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:05.510713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:05.510987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] PATH_INFO: `/v3/users/26e6580f10ef4f3da93f35a0f226cc81` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:05.512282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e6580f10ef4f3da93f35a0f226cc81)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:05.513330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: WARNING py.warnings [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:27:05.513330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: warnings.warn(msg) Jul 06 20:27:05.513330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: Jul 06 20:27:05.514530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:05.587509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e6580f10ef4f3da93f35a0f226cc81'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:27:05.606497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e6580f10ef4f3da93f35a0f226cc81'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:27:05.607301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e6580f10ef4f3da93f35a0f226cc81'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:27:05.618806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e6580f10ef4f3da93f35a0f226cc81'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:27:05.627534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:05.633092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e6580f10ef4f3da93f35a0f226cc81'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:27:05.644493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 759/1507] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:27:05 2022] DELETE /identity/v3/users/26e6580f10ef4f3da93f35a0f226cc81 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:27:05.651619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560c1be-580a-4543-a220-4cbfd7bfb0d7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:05.652079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560c1be-580a-4543-a220-4cbfd7bfb0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:05.652527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560c1be-580a-4543-a220-4cbfd7bfb0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:05.674221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5560c1be-580a-4543-a220-4cbfd7bfb0d7 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:05.675441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5560c1be-580a-4543-a220-4cbfd7bfb0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:05.740363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 749/1508] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:27:05.750581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:05.752135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:05.812706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf58d4-6ed0-4384-89c3-7473a006501c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:05.817663 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3f5a1-a775-40a2-bb2a-be0fde4d965b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:05.818365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3f5a1-a775-40a2-bb2a-be0fde4d965b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:05.818647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3f5a1-a775-40a2-bb2a-be0fde4d965b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:05.818918 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3f5a1-a775-40a2-bb2a-be0fde4d965b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:05.828735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3f5a1-a775-40a2-bb2a-be0fde4d965b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:05.830237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3f5a1-a775-40a2-bb2a-be0fde4d965b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:05.840226 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 760/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:27:06.202941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560c1be-580a-4543-a220-4cbfd7bfb0d7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:06.204721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5560c1be-580a-4543-a220-4cbfd7bfb0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:06.217889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560c1be-580a-4543-a220-4cbfd7bfb0d7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:06.223867 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:06.226732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:06.227087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:06.227443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] PATH_INFO: `/v3/projects/9b6411c3d6834ae7a904f1b77e06f3e2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:06.228896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6411c3d6834ae7a904f1b77e06f3e2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:06.230218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:27:06.230218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: warnings.warn(msg) Jul 06 20:27:06.230218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: Jul 06 20:27:06.233169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:06.298548 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6411c3d6834ae7a904f1b77e06f3e2', 'request_id': 'req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:27:06.310039 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6411c3d6834ae7a904f1b77e06f3e2', 'request_id': 'req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:27:06.317161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6411c3d6834ae7a904f1b77e06f3e2', 'request_id': 'req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:27:06.336223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] The token cache is being invalidate because project 9b6411c3d6834ae7a904f1b77e06f3e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:27:06.336397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:27:06.337133 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-17cdf8fd-3cda-4f2b-8ed6-2650e507ea7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:27:06.338805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 750/1510] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:27:06 2022] DELETE /identity/v3/projects/9b6411c3d6834ae7a904f1b77e06f3e2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:27:15.835459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=29 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:16.332894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:45.429775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49200c-de2a-4467-9914-6f440b51e345 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:45.430351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49200c-de2a-4467-9914-6f440b51e345 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:45.430351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49200c-de2a-4467-9914-6f440b51e345 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:45.431766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:45.437007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea0c25-16ab-4c87-904e-21fbee5b71e5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:45.437484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea0c25-16ab-4c87-904e-21fbee5b71e5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:45.437575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea0c25-16ab-4c87-904e-21fbee5b71e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:45.456539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5dea0c25-16ab-4c87-904e-21fbee5b71e5 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:45.457771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5dea0c25-16ab-4c87-904e-21fbee5b71e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:45.526165 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:28:45.681972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49200c-de2a-4467-9914-6f440b51e345 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:45.684691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ce49200c-de2a-4467-9914-6f440b51e345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:45.774352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49200c-de2a-4467-9914-6f440b51e345 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:45.781244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706ad9d-d7c8-4a3a-99ca-e44b9b89d7a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:45.781898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ad9d-d7c8-4a3a-99ca-e44b9b89d7a0 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:45.782171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ad9d-d7c8-4a3a-99ca-e44b9b89d7a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:45.782442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ad9d-d7c8-4a3a-99ca-e44b9b89d7a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:45.790858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706ad9d-d7c8-4a3a-99ca-e44b9b89d7a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:45.792451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706ad9d-d7c8-4a3a-99ca-e44b9b89d7a0 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:45.801966 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 762/1513] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:28:46.638559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801f10f-67b7-4c9b-8a61-8e396fd24303 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.639159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801f10f-67b7-4c9b-8a61-8e396fd24303 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.639159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801f10f-67b7-4c9b-8a61-8e396fd24303 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.640436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:46.646613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23549303-ebc0-40e0-8e20-a62ed33fc601 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.647064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23549303-ebc0-40e0-8e20-a62ed33fc601 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.647160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23549303-ebc0-40e0-8e20-a62ed33fc601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.668046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-23549303-ebc0-40e0-8e20-a62ed33fc601 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:46.669286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-23549303-ebc0-40e0-8e20-a62ed33fc601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:46.678147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:28:46.828590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801f10f-67b7-4c9b-8a61-8e396fd24303 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:46.845424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801f10f-67b7-4c9b-8a61-8e396fd24303 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:46.851717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cffcd-9595-43b2-8b53-7988d8219fe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:46.852401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cffcd-9595-43b2-8b53-7988d8219fe5 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.852689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cffcd-9595-43b2-8b53-7988d8219fe5 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.852983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cffcd-9595-43b2-8b53-7988d8219fe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.862544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cffcd-9595-43b2-8b53-7988d8219fe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:46.864441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cffcd-9595-43b2-8b53-7988d8219fe5 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:46.876251 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 753/1516] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:28:47.566107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac3f4-74c3-4f84-9e46-f72ca0dc7434 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:47.566518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac3f4-74c3-4f84-9e46-f72ca0dc7434 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:47.566802 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac3f4-74c3-4f84-9e46-f72ca0dc7434 None None] PATH_INFO: `/v3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:47.568185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 764/1517] 10.222.0.16 () {54 vars in 925 bytes} [Wed Jul 6 20:28:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:47.578255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e12c4-f2d8-4bdd-abfa-6e812e2a2036 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:47.578544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e12c4-f2d8-4bdd-abfa-6e812e2a2036 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:47.578813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e12c4-f2d8-4bdd-abfa-6e812e2a2036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:47.599224 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-943e12c4-f2d8-4bdd-abfa-6e812e2a2036 None None] MFA Rules not processed for user `e0df36a267464042908bbd8eebc7c40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:47.600600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-943e12c4-f2d8-4bdd-abfa-6e812e2a2036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:47.665432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 754/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Jul 6 20:28:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:28:51.510093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8861f44-45d4-4bb9-9b19-61fa0b1ddbe0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.510680 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8861f44-45d4-4bb9-9b19-61fa0b1ddbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.510680 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8861f44-45d4-4bb9-9b19-61fa0b1ddbe0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.514390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 765/1519] 10.222.0.30 () {54 vars in 960 bytes} [Wed Jul 6 20:28:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:51.523005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7872a-2c68-47d4-a9f3-68a366fbac1a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.523480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7872a-2c68-47d4-a9f3-68a366fbac1a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.523583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7872a-2c68-47d4-a9f3-68a366fbac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.546981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a6f7872a-2c68-47d4-a9f3-68a366fbac1a None None] MFA Rules not processed for user `e0df36a267464042908bbd8eebc7c40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:51.548166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a6f7872a-2c68-47d4-a9f3-68a366fbac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:51.558090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 755/1520] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Jul 6 20:28:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:28:51.570300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8861f44-45d4-4bb9-9b19-61fa0b1ddbe0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.591268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8861f44-45d4-4bb9-9b19-61fa0b1ddbe0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.597540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fec07e-8f36-4506-9a03-229321d6e155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df36a267464042908bbd8eebc7c40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.598186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec07e-8f36-4506-9a03-229321d6e155 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.598469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec07e-8f36-4506-9a03-229321d6e155 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.598744 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec07e-8f36-4506-9a03-229321d6e155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.608223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fec07e-8f36-4506-9a03-229321d6e155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:51.609855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fec07e-8f36-4506-9a03-229321d6e155 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:51.620389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 766/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:28:58.121960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ca5f-564f-4dc8-b6e3-60d018ebd4ac None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.122710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ca5f-564f-4dc8-b6e3-60d018ebd4ac None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.122710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ca5f-564f-4dc8-b6e3-60d018ebd4ac None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.124735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:28:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:58.129784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0f426-35eb-4a09-bc1f-db73f635aae7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.130246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0f426-35eb-4a09-bc1f-db73f635aae7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.130359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0f426-35eb-4a09-bc1f-db73f635aae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.149273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-93d0f426-35eb-4a09-bc1f-db73f635aae7 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:58.150499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-93d0f426-35eb-4a09-bc1f-db73f635aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:58.158811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:28:58.316705 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667ca5f-564f-4dc8-b6e3-60d018ebd4ac None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.336249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667ca5f-564f-4dc8-b6e3-60d018ebd4ac None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.342595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851ae35-e93d-444b-8121-9ea7ca7b371d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.343249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ae35-e93d-444b-8121-9ea7ca7b371d service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.343529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ae35-e93d-444b-8121-9ea7ca7b371d service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.343809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ae35-e93d-444b-8121-9ea7ca7b371d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.352094 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851ae35-e93d-444b-8121-9ea7ca7b371d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.353786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851ae35-e93d-444b-8121-9ea7ca7b371d service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.363497 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 757/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:28:59.184914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ac0f-e8d1-4bfb-b92b-76eb34721599 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.185416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ac0f-e8d1-4bfb-b92b-76eb34721599 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.185541 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ac0f-e8d1-4bfb-b92b-76eb34721599 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.187019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:59.192921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110443a-c147-45bf-9313-d2d4ae2ab31e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.193650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110443a-c147-45bf-9313-d2d4ae2ab31e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.193863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110443a-c147-45bf-9313-d2d4ae2ab31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.218767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9110443a-c147-45bf-9313-d2d4ae2ab31e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:59.219969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9110443a-c147-45bf-9313-d2d4ae2ab31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:59.228654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:28:59.384788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ac0f-e8d1-4bfb-b92b-76eb34721599 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:59.407845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ac0f-e8d1-4bfb-b92b-76eb34721599 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:59.416714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb5529-ef02-4ecb-9817-dae947255641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:59.417341 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb5529-ef02-4ecb-9817-dae947255641 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.417620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb5529-ef02-4ecb-9817-dae947255641 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.417890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb5529-ef02-4ecb-9817-dae947255641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.426250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb5529-ef02-4ecb-9817-dae947255641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:59.427834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb5529-ef02-4ecb-9817-dae947255641 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:59.437478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 769/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:29:03.270465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe414e-0418-418d-8789-9526e5f72530 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.271371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe414e-0418-418d-8789-9526e5f72530 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.271371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe414e-0418-418d-8789-9526e5f72530 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.273676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:03.281511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992968-f3d0-44d2-bee1-43010804081c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.281969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992968-f3d0-44d2-bee1-43010804081c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.282065 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992968-f3d0-44d2-bee1-43010804081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.301167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-52992968-f3d0-44d2-bee1-43010804081c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:03.302338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-52992968-f3d0-44d2-bee1-43010804081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:03.310561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:29:03.386695 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe414e-0418-418d-8789-9526e5f72530 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:03.388692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-43fe414e-0418-418d-8789-9526e5f72530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:03.449971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe414e-0418-418d-8789-9526e5f72530 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:03.453898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244c391-9d5c-4042-beb6-25f131a2e900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:03.454543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244c391-9d5c-4042-beb6-25f131a2e900 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.454819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244c391-9d5c-4042-beb6-25f131a2e900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.455091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244c391-9d5c-4042-beb6-25f131a2e900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.464268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244c391-9d5c-4042-beb6-25f131a2e900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:03.465730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244c391-9d5c-4042-beb6-25f131a2e900 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:03.470625 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:03.475656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 760/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:29:05.483325 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39095c-9870-4df9-a91f-b79e0138ee93 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.484366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39095c-9870-4df9-a91f-b79e0138ee93 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.484366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39095c-9870-4df9-a91f-b79e0138ee93 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.486611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:29:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:05.495532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3d39-83e4-4c1b-b561-8411a10a3741 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.496285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3d39-83e4-4c1b-b561-8411a10a3741 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.496457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3d39-83e4-4c1b-b561-8411a10a3741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.520324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-506b3d39-83e4-4c1b-b561-8411a10a3741 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:05.521599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-506b3d39-83e4-4c1b-b561-8411a10a3741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:05.530066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:29:05.570257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39095c-9870-4df9-a91f-b79e0138ee93 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:05.572696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3f39095c-9870-4df9-a91f-b79e0138ee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:05.589009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39095c-9870-4df9-a91f-b79e0138ee93 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:05.593562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61a285-6913-4502-96ad-589f19cf3794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:05.594258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61a285-6913-4502-96ad-589f19cf3794 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.594587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61a285-6913-4502-96ad-589f19cf3794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.594866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61a285-6913-4502-96ad-589f19cf3794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.606396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61a285-6913-4502-96ad-589f19cf3794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:05.607837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61a285-6913-4502-96ad-589f19cf3794 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:05.618959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 772/1533] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:29:09.262539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec46038-1130-44b1-a928-d29e856340cc None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:09.263398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec46038-1130-44b1-a928-d29e856340cc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:09.263398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec46038-1130-44b1-a928-d29e856340cc None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:09.265664 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:29:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:09.271891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b56534-6574-468c-a82b-70a61796caf5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:09.272650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b56534-6574-468c-a82b-70a61796caf5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:09.272815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b56534-6574-468c-a82b-70a61796caf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:09.284162 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=62 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:09.299693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-04b56534-6574-468c-a82b-70a61796caf5 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:09.300904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-04b56534-6574-468c-a82b-70a61796caf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:09.310441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:29:09.608021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec46038-1130-44b1-a928-d29e856340cc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:09.610891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9ec46038-1130-44b1-a928-d29e856340cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:09.673669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec46038-1130-44b1-a928-d29e856340cc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:09.678081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916c3ba-abed-42e7-b594-e1c3993cb206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:09.678725 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c3ba-abed-42e7-b594-e1c3993cb206 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:09.679009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c3ba-abed-42e7-b594-e1c3993cb206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:09.679286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c3ba-abed-42e7-b594-e1c3993cb206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:09.689138 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916c3ba-abed-42e7-b594-e1c3993cb206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:09.690567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916c3ba-abed-42e7-b594-e1c3993cb206 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:09.700131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 763/1536] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:29:12.062722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc852be-fccf-4afa-99c8-0fe515387698 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:12.063294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc852be-fccf-4afa-99c8-0fe515387698 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:12.063294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc852be-fccf-4afa-99c8-0fe515387698 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:12.064635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:12.072122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8a88-9572-4b10-9c3d-edc445e7bf20 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:12.072525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8a88-9572-4b10-9c3d-edc445e7bf20 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:12.072673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8a88-9572-4b10-9c3d-edc445e7bf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:12.093424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7f4b8a88-9572-4b10-9c3d-edc445e7bf20 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:12.094561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7f4b8a88-9572-4b10-9c3d-edc445e7bf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:12.103663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:29:12.412415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc852be-fccf-4afa-99c8-0fe515387698 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:12.415192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cdc852be-fccf-4afa-99c8-0fe515387698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:12.428817 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc852be-fccf-4afa-99c8-0fe515387698 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:12.432452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405b626-d3bb-4f68-a554-0f25064d046d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:12.433123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405b626-d3bb-4f68-a554-0f25064d046d service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:12.433449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405b626-d3bb-4f68-a554-0f25064d046d service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:12.433750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405b626-d3bb-4f68-a554-0f25064d046d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:12.443917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405b626-d3bb-4f68-a554-0f25064d046d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:12.445445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405b626-d3bb-4f68-a554-0f25064d046d service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:12.457909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 775/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:29:22.087979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=32 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:22.451189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=8 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:40.103035 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb34a7c-279d-465e-a0a5-27d95aeaca57 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.103746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb34a7c-279d-465e-a0a5-27d95aeaca57 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.103746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb34a7c-279d-465e-a0a5-27d95aeaca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.127257 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6bb34a7c-279d-465e-a0a5-27d95aeaca57 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:40.128516 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6bb34a7c-279d-465e-a0a5-27d95aeaca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:40.137732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 765/1540] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:40.151078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e7c6-e35c-4e59-9754-0ea16a8526c4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.151637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e7c6-e35c-4e59-9754-0ea16a8526c4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.151637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e7c6-e35c-4e59-9754-0ea16a8526c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.172548 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1f90e7c6-e35c-4e59-9754-0ea16a8526c4 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:40.173778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f90e7c6-e35c-4e59-9754-0ea16a8526c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:40.182457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 776/1541] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:40.187404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb34a7c-279d-465e-a0a5-27d95aeaca57 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.198244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb34a7c-279d-465e-a0a5-27d95aeaca57 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.202936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccc2da-6695-4f5a-b2be-e01b9b19b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.203606 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccc2da-6695-4f5a-b2be-e01b9b19b198 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.203883 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccc2da-6695-4f5a-b2be-e01b9b19b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.204153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccc2da-6695-4f5a-b2be-e01b9b19b198 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.205041 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccc2da-6695-4f5a-b2be-e01b9b19b198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:40.205351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccc2da-6695-4f5a-b2be-e01b9b19b198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.207104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccc2da-6695-4f5a-b2be-e01b9b19b198 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.220230 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 766/1542] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:40.228995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90e7c6-e35c-4e59-9754-0ea16a8526c4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.239210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90e7c6-e35c-4e59-9754-0ea16a8526c4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.244417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b5107-22d3-4652-8ee6-8a3a5bcdefb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.245135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5107-22d3-4652-8ee6-8a3a5bcdefb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.245415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5107-22d3-4652-8ee6-8a3a5bcdefb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.245893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5107-22d3-4652-8ee6-8a3a5bcdefb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.247037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b5107-22d3-4652-8ee6-8a3a5bcdefb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.248982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b5107-22d3-4652-8ee6-8a3a5bcdefb6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.291083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 777/1543] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:40 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:30:40.296502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccc2da-6695-4f5a-b2be-e01b9b19b198 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.306668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e283d-e8c1-455a-92b7-41eefbb0eddc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.306988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e283d-e8c1-455a-92b7-41eefbb0eddc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.307222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e283d-e8c1-455a-92b7-41eefbb0eddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.307461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccc2da-6695-4f5a-b2be-e01b9b19b198 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.353917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-360e283d-e8c1-455a-92b7-41eefbb0eddc None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:40.355050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-360e283d-e8c1-455a-92b7-41eefbb0eddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:40.409500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82e1fc-759d-414f-85a8-3f490af56416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.410294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e1fc-759d-414f-85a8-3f490af56416 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.410583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e1fc-759d-414f-85a8-3f490af56416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.410856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e1fc-759d-414f-85a8-3f490af56416 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.411840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82e1fc-759d-414f-85a8-3f490af56416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.416981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82e1fc-759d-414f-85a8-3f490af56416 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.462614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 767/1544] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:40 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:40.476518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82e1fc-759d-414f-85a8-3f490af56416 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.519333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82e1fc-759d-414f-85a8-3f490af56416 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.528015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 778/1545] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:40.530177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae30e53-1a0d-4dfb-8213-95fe497c6567 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.533125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae30e53-1a0d-4dfb-8213-95fe497c6567 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.533535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae30e53-1a0d-4dfb-8213-95fe497c6567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.549815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb0537-1e16-4dca-b265-ad83bd060f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.550503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb0537-1e16-4dca-b265-ad83bd060f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.550783 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb0537-1e16-4dca-b265-ad83bd060f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.551058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb0537-1e16-4dca-b265-ad83bd060f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.551807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb0537-1e16-4dca-b265-ad83bd060f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.553534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb0537-1e16-4dca-b265-ad83bd060f23 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.566094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5ae30e53-1a0d-4dfb-8213-95fe497c6567 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:40.567328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5ae30e53-1a0d-4dfb-8213-95fe497c6567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:40.576465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 768/1546] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:40.577873 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afeb0f-75e9-4e8f-bb9a-a46474644f97 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.578158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afeb0f-75e9-4e8f-bb9a-a46474644f97 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.578431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afeb0f-75e9-4e8f-bb9a-a46474644f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.582808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 779/1547] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:40.585862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae30e53-1a0d-4dfb-8213-95fe497c6567 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.596699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae30e53-1a0d-4dfb-8213-95fe497c6567 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.634008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec067138-793b-40ce-8c90-15c5e31a3ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.634613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067138-793b-40ce-8c90-15c5e31a3ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.634889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067138-793b-40ce-8c90-15c5e31a3ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.635156 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067138-793b-40ce-8c90-15c5e31a3ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.636481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec067138-793b-40ce-8c90-15c5e31a3ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.638134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b5afeb0f-75e9-4e8f-bb9a-a46474644f97 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:40.638629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec067138-793b-40ce-8c90-15c5e31a3ff2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.639360 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b5afeb0f-75e9-4e8f-bb9a-a46474644f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:40.661804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 780/1548] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:30:40.663362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935b49-5bd6-4885-b475-6a3b6126f3a8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.663647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935b49-5bd6-4885-b475-6a3b6126f3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.663923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935b49-5bd6-4885-b475-6a3b6126f3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.683096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 769/1549] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:40.684095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afeb0f-75e9-4e8f-bb9a-a46474644f97 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.702215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b3935b49-5bd6-4885-b475-6a3b6126f3a8 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:40.703455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b3935b49-5bd6-4885-b475-6a3b6126f3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:40.707442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afeb0f-75e9-4e8f-bb9a-a46474644f97 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.718984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 781/1550] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:40.719869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3935b49-5bd6-4885-b475-6a3b6126f3a8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.736002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3935b49-5bd6-4885-b475-6a3b6126f3a8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.742039 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb2063-92ab-4e9f-bc54-0dc01f2c84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.742969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb2063-92ab-4e9f-bc54-0dc01f2c84f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.743221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb2063-92ab-4e9f-bc54-0dc01f2c84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.743542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb2063-92ab-4e9f-bc54-0dc01f2c84f7 admin admin] PATH_INFO: `/v3/projects/fa6fd781857e4438bf3a3874260a38c4/users/be36cfe778ac40c08f8d5c50ba26f1fb/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.757643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428704c-a10c-4631-b00a-b9575adb82e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.758336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428704c-a10c-4631-b00a-b9575adb82e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.758612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428704c-a10c-4631-b00a-b9575adb82e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.758883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428704c-a10c-4631-b00a-b9575adb82e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.759667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428704c-a10c-4631-b00a-b9575adb82e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:40.759975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428704c-a10c-4631-b00a-b9575adb82e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.761025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: WARNING py.warnings [None req-6428704c-a10c-4631-b00a-b9575adb82e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:30:40.761025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: warnings.warn(msg) Jul 06 20:30:40.761025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: Jul 06 20:30:40.762086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428704c-a10c-4631-b00a-b9575adb82e6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.779958 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 782/1551] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:40.781770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428704c-a10c-4631-b00a-b9575adb82e6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.798221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb2063-92ab-4e9f-bc54-0dc01f2c84f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6fd781857e4438bf3a3874260a38c4, user_id=be36cfe778ac40c08f8d5c50ba26f1fb, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.799289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-77bb2063-92ab-4e9f-bc54-0dc01f2c84f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:30:40.799289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: warnings.warn(msg) Jul 06 20:30:40.799289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: Jul 06 20:30:40.799808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428704c-a10c-4631-b00a-b9575adb82e6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.801302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb2063-92ab-4e9f-bc54-0dc01f2c84f7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.812523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab908e-b367-4bc5-a73c-24495fad19c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.813987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab908e-b367-4bc5-a73c-24495fad19c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.814270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab908e-b367-4bc5-a73c-24495fad19c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.814545 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab908e-b367-4bc5-a73c-24495fad19c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.815344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab908e-b367-4bc5-a73c-24495fad19c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:40.815654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab908e-b367-4bc5-a73c-24495fad19c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.817852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab908e-b367-4bc5-a73c-24495fad19c4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.846793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 770/1552] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:40 2022] PUT /identity/v3/projects/fa6fd781857e4438bf3a3874260a38c4/users/be36cfe778ac40c08f8d5c50ba26f1fb/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:40.847632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb2063-92ab-4e9f-bc54-0dc01f2c84f7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.852312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 783/1553] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:40.853794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d5c61-cf1b-425c-9519-cdee2c76c5e2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.854081 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d5c61-cf1b-425c-9519-cdee2c76c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.854357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d5c61-cf1b-425c-9519-cdee2c76c5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.879923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1e6d5c61-cf1b-425c-9519-cdee2c76c5e2 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:40.881165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1e6d5c61-cf1b-425c-9519-cdee2c76c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:40.978157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 784/1554] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:40.982049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d5c61-cf1b-425c-9519-cdee2c76c5e2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.991387 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb2063-92ab-4e9f-bc54-0dc01f2c84f7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.993288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d5c61-cf1b-425c-9519-cdee2c76c5e2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.997194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16038f2-b996-403f-95f8-a1de2c96cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.997997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceed6ec-97d2-4756-8a5b-7e2ffea63ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.998378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16038f2-b996-403f-95f8-a1de2c96cec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.998667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceed6ec-97d2-4756-8a5b-7e2ffea63ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.998938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceed6ec-97d2-4756-8a5b-7e2ffea63ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.999209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceed6ec-97d2-4756-8a5b-7e2ffea63ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.999567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16038f2-b996-403f-95f8-a1de2c96cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.000012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceed6ec-97d2-4756-8a5b-7e2ffea63ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.000528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16038f2-b996-403f-95f8-a1de2c96cec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.001305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16038f2-b996-403f-95f8-a1de2c96cec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.001965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceed6ec-97d2-4756-8a5b-7e2ffea63ad7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.002853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-b16038f2-b996-403f-95f8-a1de2c96cec9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:30:41.002853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: warnings.warn(msg) Jul 06 20:30:41.002853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: Jul 06 20:30:41.004069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16038f2-b996-403f-95f8-a1de2c96cec9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.024674 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:41.032832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 785/1555] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:40 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:41.033293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 771/1556] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:40 2022] POST /identity/v3/projects => generated 389 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:41.034735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ebee1-4482-4a82-bff1-c2c18fcdedb0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.034888 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25a33d-6929-4bbb-83ee-8ff4a68992b2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.035084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ebee1-4482-4a82-bff1-c2c18fcdedb0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.035199 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25a33d-6929-4bbb-83ee-8ff4a68992b2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.035402 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25a33d-6929-4bbb-83ee-8ff4a68992b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.035504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ebee1-4482-4a82-bff1-c2c18fcdedb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.053670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e30ebee1-4482-4a82-bff1-c2c18fcdedb0 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:41.055000 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e30ebee1-4482-4a82-bff1-c2c18fcdedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:41.062163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-aa25a33d-6929-4bbb-83ee-8ff4a68992b2 None None] MFA Rules not processed for user `be36cfe778ac40c08f8d5c50ba26f1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:41.063404 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aa25a33d-6929-4bbb-83ee-8ff4a68992b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:41.065705 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:41.117151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 772/1557] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:41.118560 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c05d9-e623-4077-97f4-0fc9cbc87628 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.118846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c05d9-e623-4077-97f4-0fc9cbc87628 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.119128 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c05d9-e623-4077-97f4-0fc9cbc87628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.129349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 786/1558] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:41.130643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786d89-fc10-4fac-adad-872e9443e367 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.130887 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786d89-fc10-4fac-adad-872e9443e367 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.131613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786d89-fc10-4fac-adad-872e9443e367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.137318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-881c05d9-e623-4077-97f4-0fc9cbc87628 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:41.138711 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-881c05d9-e623-4077-97f4-0fc9cbc87628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:41.149441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 773/1559] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:41.149441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1dd1-bbd9-462a-acde-7aad9d6b4d47 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.149441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1dd1-bbd9-462a-acde-7aad9d6b4d47 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.149441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1dd1-bbd9-462a-acde-7aad9d6b4d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.157278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d2786d89-fc10-4fac-adad-872e9443e367 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:41.158523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d2786d89-fc10-4fac-adad-872e9443e367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:41.170055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 787/1560] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:41.171253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdbf6e-88ae-48b4-911c-393359192615 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.171736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdbf6e-88ae-48b4-911c-393359192615 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.172063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdbf6e-88ae-48b4-911c-393359192615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.173437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ea1b1dd1-bbd9-462a-acde-7aad9d6b4d47 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:41.174628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ea1b1dd1-bbd9-462a-acde-7aad9d6b4d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:41.183018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 774/1561] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:41.183865 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b1dd1-bbd9-462a-acde-7aad9d6b4d47 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.192555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8acdbf6e-88ae-48b4-911c-393359192615 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:41.193279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b1dd1-bbd9-462a-acde-7aad9d6b4d47 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.193775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8acdbf6e-88ae-48b4-911c-393359192615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:41.198040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8703c2c-58b0-4108-ac74-142ea6a5e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.198767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703c2c-58b0-4108-ac74-142ea6a5e901 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.199118 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703c2c-58b0-4108-ac74-142ea6a5e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.199455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703c2c-58b0-4108-ac74-142ea6a5e901 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.200228 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8703c2c-58b0-4108-ac74-142ea6a5e901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.201880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 788/1562] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:41.202344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8703c2c-58b0-4108-ac74-142ea6a5e901 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.202647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdbf6e-88ae-48b4-911c-393359192615 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.212448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdbf6e-88ae-48b4-911c-393359192615 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.218071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee314cc-25be-45dc-8974-aa0183d7da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.218754 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee314cc-25be-45dc-8974-aa0183d7da8e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.219037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee314cc-25be-45dc-8974-aa0183d7da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.219321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee314cc-25be-45dc-8974-aa0183d7da8e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.220064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee314cc-25be-45dc-8974-aa0183d7da8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.221439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: WARNING py.warnings [None req-2ee314cc-25be-45dc-8974-aa0183d7da8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:30:41.221439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: warnings.warn(msg) Jul 06 20:30:41.221439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: Jul 06 20:30:41.222632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee314cc-25be-45dc-8974-aa0183d7da8e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.229405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 775/1563] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:41.229405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552d73-a814-42bb-a7e8-e8dba7d61d48 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.229405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552d73-a814-42bb-a7e8-e8dba7d61d48 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.229405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552d73-a814-42bb-a7e8-e8dba7d61d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.244041 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 789/1564] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/users => generated 303 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:41.245329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eb394-5311-4aea-b986-315bd550bb96 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.245726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eb394-5311-4aea-b986-315bd550bb96 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.245999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eb394-5311-4aea-b986-315bd550bb96 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.246214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fb552d73-a814-42bb-a7e8-e8dba7d61d48 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:41.247259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 790/1565] 10.222.0.30 () {54 vars in 961 bytes} [Wed Jul 6 20:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:41.247408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fb552d73-a814-42bb-a7e8-e8dba7d61d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:41.248286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6af2-b9dc-41bc-a1d2-f499d8c4cbc9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.248563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6af2-b9dc-41bc-a1d2-f499d8c4cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.248835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6af2-b9dc-41bc-a1d2-f499d8c4cbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.255747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 776/1566] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:41.257841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14caf-c4b4-466e-b9e2-4bbb69fe5e9f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.258131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14caf-c4b4-466e-b9e2-4bbb69fe5e9f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.258406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14caf-c4b4-466e-b9e2-4bbb69fe5e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.268177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2cef6af2-b9dc-41bc-a1d2-f499d8c4cbc9 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:41.269445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2cef6af2-b9dc-41bc-a1d2-f499d8c4cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:41.276386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-79c14caf-c4b4-466e-b9e2-4bbb69fe5e9f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:41.277586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-79c14caf-c4b4-466e-b9e2-4bbb69fe5e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:41.279637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 791/1567] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:41.280609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef6af2-b9dc-41bc-a1d2-f499d8c4cbc9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.287539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 777/1568] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:41.289035 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af92d-8314-4704-979a-54abe00bc1ac None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.289296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af92d-8314-4704-979a-54abe00bc1ac None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.289694 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af92d-8314-4704-979a-54abe00bc1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.290374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef6af2-b9dc-41bc-a1d2-f499d8c4cbc9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.294972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596f9a7-2212-429c-83a7-07b3f4ac275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.295614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f9a7-2212-429c-83a7-07b3f4ac275a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.295893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f9a7-2212-429c-83a7-07b3f4ac275a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.296169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f9a7-2212-429c-83a7-07b3f4ac275a admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.296908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596f9a7-2212-429c-83a7-07b3f4ac275a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:41.297246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596f9a7-2212-429c-83a7-07b3f4ac275a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.298855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596f9a7-2212-429c-83a7-07b3f4ac275a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.307505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7f0af92d-8314-4704-979a-54abe00bc1ac None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:41.308717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7f0af92d-8314-4704-979a-54abe00bc1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:41.310511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 792/1569] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:41.311359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596f9a7-2212-429c-83a7-07b3f4ac275a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.321324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 778/1570] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:41.322198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0af92d-8314-4704-979a-54abe00bc1ac None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.325398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596f9a7-2212-429c-83a7-07b3f4ac275a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.330293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7ed67-163e-45d5-add8-4ecddba1d8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.330942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7ed67-163e-45d5-add8-4ecddba1d8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.331221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7ed67-163e-45d5-add8-4ecddba1d8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.331466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0af92d-8314-4704-979a-54abe00bc1ac None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.331614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7ed67-163e-45d5-add8-4ecddba1d8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.332250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7ed67-163e-45d5-add8-4ecddba1d8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.334303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7ed67-163e-45d5-add8-4ecddba1d8f8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.336418 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fa1e5-3a02-44ba-a397-ae4ace7a9a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.337101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fa1e5-3a02-44ba-a397-ae4ace7a9a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.337442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fa1e5-3a02-44ba-a397-ae4ace7a9a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.337721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fa1e5-3a02-44ba-a397-ae4ace7a9a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.338456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fa1e5-3a02-44ba-a397-ae4ace7a9a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.340095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fa1e5-3a02-44ba-a397-ae4ace7a9a8b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.344680 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 793/1571] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:41.345989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386d8a1-c949-4043-b658-cce33158d9fa None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.346278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386d8a1-c949-4043-b658-cce33158d9fa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.346550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386d8a1-c949-4043-b658-cce33158d9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.355627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 779/1572] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:41.355627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fa1e5-3a02-44ba-a397-ae4ace7a9a8b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.364200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c386d8a1-c949-4043-b658-cce33158d9fa None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:41.365422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c386d8a1-c949-4043-b658-cce33158d9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:41.366068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fa1e5-3a02-44ba-a397-ae4ace7a9a8b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.371759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80254baf-d0fe-41ac-a4fd-ad2005221bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.372403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80254baf-d0fe-41ac-a4fd-ad2005221bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.372683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80254baf-d0fe-41ac-a4fd-ad2005221bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.372950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80254baf-d0fe-41ac-a4fd-ad2005221bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.373738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80254baf-d0fe-41ac-a4fd-ad2005221bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:41.374038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80254baf-d0fe-41ac-a4fd-ad2005221bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.375672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80254baf-d0fe-41ac-a4fd-ad2005221bcc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.389378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 780/1573] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:41.390221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80254baf-d0fe-41ac-a4fd-ad2005221bcc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.400367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80254baf-d0fe-41ac-a4fd-ad2005221bcc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.406848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce6289-1c06-4c18-b677-3a3024c1d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.407715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce6289-1c06-4c18-b677-3a3024c1d633 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.408181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce6289-1c06-4c18-b677-3a3024c1d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.408652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce6289-1c06-4c18-b677-3a3024c1d633 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.409641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce6289-1c06-4c18-b677-3a3024c1d633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:41.409946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce6289-1c06-4c18-b677-3a3024c1d633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.411545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce6289-1c06-4c18-b677-3a3024c1d633 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.423876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 781/1574] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:41.424746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce6289-1c06-4c18-b677-3a3024c1d633 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.435919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce6289-1c06-4c18-b677-3a3024c1d633 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.440427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a6f3c-b035-4c5e-a6fa-eb65f5306656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.441108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a6f3c-b035-4c5e-a6fa-eb65f5306656 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.441386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a6f3c-b035-4c5e-a6fa-eb65f5306656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.441663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a6f3c-b035-4c5e-a6fa-eb65f5306656 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.442394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a6f3c-b035-4c5e-a6fa-eb65f5306656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:41.442700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a6f3c-b035-4c5e-a6fa-eb65f5306656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.444297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a6f3c-b035-4c5e-a6fa-eb65f5306656 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.447532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 794/1575] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:41.448389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386d8a1-c949-4043-b658-cce33158d9fa None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.456813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 782/1576] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:41.457759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a6f3c-b035-4c5e-a6fa-eb65f5306656 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.458307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386d8a1-c949-4043-b658-cce33158d9fa None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.463249 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73f214-b5b9-4aba-9bc7-bcda8fd33926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.464011 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73f214-b5b9-4aba-9bc7-bcda8fd33926 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.464298 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73f214-b5b9-4aba-9bc7-bcda8fd33926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.464581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73f214-b5b9-4aba-9bc7-bcda8fd33926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.465311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73f214-b5b9-4aba-9bc7-bcda8fd33926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.467223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73f214-b5b9-4aba-9bc7-bcda8fd33926 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.469072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a6f3c-b035-4c5e-a6fa-eb65f5306656 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.474194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e55b5-a361-4044-818e-677e7f414936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.474844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e55b5-a361-4044-818e-677e7f414936 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.475122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e55b5-a361-4044-818e-677e7f414936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.475398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e55b5-a361-4044-818e-677e7f414936 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.476127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e55b5-a361-4044-818e-677e7f414936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:41.476430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e55b5-a361-4044-818e-677e7f414936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.478087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e55b5-a361-4044-818e-677e7f414936 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.486832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:41.491187 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 783/1577] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:41.492520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e55b5-a361-4044-818e-677e7f414936 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.501024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 795/1578] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:41.501954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73f214-b5b9-4aba-9bc7-bcda8fd33926 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.508067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e55b5-a361-4044-818e-677e7f414936 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.563552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73f214-b5b9-4aba-9bc7-bcda8fd33926 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.564255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86547f76-4cbc-4ccd-af97-c6af4ebffd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.564943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86547f76-4cbc-4ccd-af97-c6af4ebffd85 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.565322 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86547f76-4cbc-4ccd-af97-c6af4ebffd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.565522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86547f76-4cbc-4ccd-af97-c6af4ebffd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.566268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86547f76-4cbc-4ccd-af97-c6af4ebffd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.567936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86547f76-4cbc-4ccd-af97-c6af4ebffd85 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.568231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939d37-5dea-44c1-923d-60e708d5f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.568895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939d37-5dea-44c1-923d-60e708d5f6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.569206 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939d37-5dea-44c1-923d-60e708d5f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.569302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:41.569495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939d37-5dea-44c1-923d-60e708d5f6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.570227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce939d37-5dea-44c1-923d-60e708d5f6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.571807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce939d37-5dea-44c1-923d-60e708d5f6ee admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.579439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 784/1579] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:41.580494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86547f76-4cbc-4ccd-af97-c6af4ebffd85 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.581855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 796/1580] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:41.582646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939d37-5dea-44c1-923d-60e708d5f6ee admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.592083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939d37-5dea-44c1-923d-60e708d5f6ee admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.593556 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86547f76-4cbc-4ccd-af97-c6af4ebffd85 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.596731 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b70bf4-9589-4fd0-85aa-e15cc8231001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.597448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b70bf4-9589-4fd0-85aa-e15cc8231001 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.597733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b70bf4-9589-4fd0-85aa-e15cc8231001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.597994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eacd09-dfe6-4c1d-947a-300b0b7e7e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.598103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b70bf4-9589-4fd0-85aa-e15cc8231001 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.598641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eacd09-dfe6-4c1d-947a-300b0b7e7e04 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.598744 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b70bf4-9589-4fd0-85aa-e15cc8231001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.598918 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eacd09-dfe6-4c1d-947a-300b0b7e7e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.599187 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eacd09-dfe6-4c1d-947a-300b0b7e7e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.599870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eacd09-dfe6-4c1d-947a-300b0b7e7e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.600588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b70bf4-9589-4fd0-85aa-e15cc8231001 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.601803 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eacd09-dfe6-4c1d-947a-300b0b7e7e04 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.635767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 785/1581] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:41.635767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eacd09-dfe6-4c1d-947a-300b0b7e7e04 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.636075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 797/1582] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:41.636075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b70bf4-9589-4fd0-85aa-e15cc8231001 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.693332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b70bf4-9589-4fd0-85aa-e15cc8231001 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.698398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d133b-4910-4061-a254-74d56954ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.699082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d133b-4910-4061-a254-74d56954ff44 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.699362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d133b-4910-4061-a254-74d56954ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.699634 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d133b-4910-4061-a254-74d56954ff44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.700339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d133b-4910-4061-a254-74d56954ff44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.701713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eacd09-dfe6-4c1d-947a-300b0b7e7e04 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.702348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d133b-4910-4061-a254-74d56954ff44 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.731593 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 798/1583] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:41.735432 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d133b-4910-4061-a254-74d56954ff44 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.771562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d164a7-6b4b-4402-84ab-c9b406e1ccee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.772135 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d164a7-6b4b-4402-84ab-c9b406e1ccee service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.772413 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d164a7-6b4b-4402-84ab-c9b406e1ccee service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.772686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d164a7-6b4b-4402-84ab-c9b406e1ccee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.789660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:41.793734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d133b-4910-4061-a254-74d56954ff44 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.800145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113b79e-cb48-4f6e-a331-3dc85f0b4e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.801090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113b79e-cb48-4f6e-a331-3dc85f0b4e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.801388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113b79e-cb48-4f6e-a331-3dc85f0b4e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.801657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113b79e-cb48-4f6e-a331-3dc85f0b4e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.802350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113b79e-cb48-4f6e-a331-3dc85f0b4e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.805268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113b79e-cb48-4f6e-a331-3dc85f0b4e65 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.833832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 799/1584] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:41.834002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d164a7-6b4b-4402-84ab-c9b406e1ccee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.834765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113b79e-cb48-4f6e-a331-3dc85f0b4e65 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.835828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d164a7-6b4b-4402-84ab-c9b406e1ccee service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.845147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 786/1585] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:41.846024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d164a7-6b4b-4402-84ab-c9b406e1ccee service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.855667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d164a7-6b4b-4402-84ab-c9b406e1ccee service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.861255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:41.903536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113b79e-cb48-4f6e-a331-3dc85f0b4e65 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.910418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c06951-ee0b-46c1-a2c5-b9bf1ef37e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.911566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c06951-ee0b-46c1-a2c5-b9bf1ef37e7e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.911772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c06951-ee0b-46c1-a2c5-b9bf1ef37e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.912158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c06951-ee0b-46c1-a2c5-b9bf1ef37e7e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.912995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c06951-ee0b-46c1-a2c5-b9bf1ef37e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.915058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c06951-ee0b-46c1-a2c5-b9bf1ef37e7e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.915960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a99fd-a03c-4b90-8910-ef30b6ed9340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:41.916894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a99fd-a03c-4b90-8910-ef30b6ed9340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:41.917160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a99fd-a03c-4b90-8910-ef30b6ed9340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:41.917431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a99fd-a03c-4b90-8910-ef30b6ed9340 admin admin] PATH_INFO: `/v3/projects/8bd9a1e1ce0a4f4c92ba744aa3ce63f5/users/3c50cd073cfa45bc9dc52dc65bf7e945/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:41.933043 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a99fd-a03c-4b90-8910-ef30b6ed9340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd9a1e1ce0a4f4c92ba744aa3ce63f5, user_id=3c50cd073cfa45bc9dc52dc65bf7e945, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:41.936743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a99fd-a03c-4b90-8910-ef30b6ed9340 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:41.939177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 800/1586] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:41.941832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c06951-ee0b-46c1-a2c5-b9bf1ef37e7e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:41.951564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 787/1587] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:41 2022] PUT /identity/v3/projects/8bd9a1e1ce0a4f4c92ba744aa3ce63f5/users/3c50cd073cfa45bc9dc52dc65bf7e945/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:41.952069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c06951-ee0b-46c1-a2c5-b9bf1ef37e7e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:41.952211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a99fd-a03c-4b90-8910-ef30b6ed9340 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.011410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1c5e-661d-407d-a973-181b2c9cb33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.012505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1c5e-661d-407d-a973-181b2c9cb33b admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.012882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1c5e-661d-407d-a973-181b2c9cb33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.013303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1c5e-661d-407d-a973-181b2c9cb33b admin admin] PATH_INFO: `/v3/projects/53bf81c98cb74e4faad8a44f6b69e6d8/users/8aa2d7827b084e949863c294a960be91/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.030778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a99fd-a03c-4b90-8910-ef30b6ed9340 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.031071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e1c5e-661d-407d-a973-181b2c9cb33b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53bf81c98cb74e4faad8a44f6b69e6d8, user_id=8aa2d7827b084e949863c294a960be91, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.034239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e1c5e-661d-407d-a973-181b2c9cb33b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.036567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adaac5-da6d-4e92-bffb-328086a3d9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.037333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adaac5-da6d-4e92-bffb-328086a3d9fc admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.037613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adaac5-da6d-4e92-bffb-328086a3d9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.037886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adaac5-da6d-4e92-bffb-328086a3d9fc admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.039797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adaac5-da6d-4e92-bffb-328086a3d9fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.042314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adaac5-da6d-4e92-bffb-328086a3d9fc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.051827 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 801/1588] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:41 2022] PUT /identity/v3/projects/53bf81c98cb74e4faad8a44f6b69e6d8/users/8aa2d7827b084e949863c294a960be91/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:42.052498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1c5e-661d-407d-a973-181b2c9cb33b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.070245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 788/1589] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:41 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:42.073835 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adaac5-da6d-4e92-bffb-328086a3d9fc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.084277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adaac5-da6d-4e92-bffb-328086a3d9fc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.113377 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:42.119808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1c5e-661d-407d-a973-181b2c9cb33b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.126663 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba7f04-f012-4362-a703-fce7ea5d23a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.127470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba7f04-f012-4362-a703-fce7ea5d23a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.127754 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba7f04-f012-4362-a703-fce7ea5d23a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.128027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba7f04-f012-4362-a703-fce7ea5d23a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.128718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba7f04-f012-4362-a703-fce7ea5d23a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.130707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba7f04-f012-4362-a703-fce7ea5d23a7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.142073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d036201-6882-4cc8-9ae2-7fb45d18d9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.142832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036201-6882-4cc8-9ae2-7fb45d18d9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.143178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036201-6882-4cc8-9ae2-7fb45d18d9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.143623 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036201-6882-4cc8-9ae2-7fb45d18d9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.144330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d036201-6882-4cc8-9ae2-7fb45d18d9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.146620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d036201-6882-4cc8-9ae2-7fb45d18d9e8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.152477 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 802/1590] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:42 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:42.153359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba7f04-f012-4362-a703-fce7ea5d23a7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.166087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba7f04-f012-4362-a703-fce7ea5d23a7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.168023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 789/1591] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:42 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:42.168790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d036201-6882-4cc8-9ae2-7fb45d18d9e8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.170799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68b16c-19cb-4b83-84f5-d13651e93f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.171518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68b16c-19cb-4b83-84f5-d13651e93f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.171792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68b16c-19cb-4b83-84f5-d13651e93f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.172057 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68b16c-19cb-4b83-84f5-d13651e93f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.172742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68b16c-19cb-4b83-84f5-d13651e93f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.174703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68b16c-19cb-4b83-84f5-d13651e93f88 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.179948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d036201-6882-4cc8-9ae2-7fb45d18d9e8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.184419 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd975754-727e-4c31-9031-29a79e047d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.185198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd975754-727e-4c31-9031-29a79e047d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.185565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd975754-727e-4c31-9031-29a79e047d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.185758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd975754-727e-4c31-9031-29a79e047d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.186612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd975754-727e-4c31-9031-29a79e047d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.188425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd975754-727e-4c31-9031-29a79e047d22 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.193838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:42.196654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 803/1592] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:42 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:42.198147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e3998-457b-408b-b902-3eb34af41dbb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.198433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e3998-457b-408b-b902-3eb34af41dbb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.198886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e3998-457b-408b-b902-3eb34af41dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.202846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 790/1593] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:42.204399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3ee0c-bb68-43f0-a760-732d0f37d4b7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.204829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3ee0c-bb68-43f0-a760-732d0f37d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.205286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3ee0c-bb68-43f0-a760-732d0f37d4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.216390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-711e3998-457b-408b-b902-3eb34af41dbb None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:42.217737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-711e3998-457b-408b-b902-3eb34af41dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:42.226256 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 804/1594] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:42.227676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e3998-457b-408b-b902-3eb34af41dbb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.244378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e3998-457b-408b-b902-3eb34af41dbb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.249888 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2ea2b-c1a4-4844-8020-5d1e283fde29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.250757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2ea2b-c1a4-4844-8020-5d1e283fde29 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.251042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2ea2b-c1a4-4844-8020-5d1e283fde29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.251317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2ea2b-c1a4-4844-8020-5d1e283fde29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.252074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2ea2b-c1a4-4844-8020-5d1e283fde29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.253761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2ea2b-c1a4-4844-8020-5d1e283fde29 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.265403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 805/1595] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:42.267820 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd60f8-c523-4ef8-9408-cec861d21d78 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.268262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd60f8-c523-4ef8-9408-cec861d21d78 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.268606 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd60f8-c523-4ef8-9408-cec861d21d78 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.270213 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 806/1596] 10.222.0.30 () {54 vars in 912 bytes} [Wed Jul 6 20:30:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:42.271093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd60f8-c523-4ef8-9408-cec861d21d78 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.284628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd60f8-c523-4ef8-9408-cec861d21d78 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.289287 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096d9ed-7c71-49ff-9fd7-b97bd3e0b29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.289950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096d9ed-7c71-49ff-9fd7-b97bd3e0b29c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.290263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096d9ed-7c71-49ff-9fd7-b97bd3e0b29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.290542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096d9ed-7c71-49ff-9fd7-b97bd3e0b29c admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.291290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096d9ed-7c71-49ff-9fd7-b97bd3e0b29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.292919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096d9ed-7c71-49ff-9fd7-b97bd3e0b29c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.307692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 807/1597] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:42.307692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096d9ed-7c71-49ff-9fd7-b97bd3e0b29c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.318969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096d9ed-7c71-49ff-9fd7-b97bd3e0b29c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.323990 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee89c52-7bad-4eb5-be27-17d4f071db9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.324682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee89c52-7bad-4eb5-be27-17d4f071db9a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.324985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee89c52-7bad-4eb5-be27-17d4f071db9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.325275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee89c52-7bad-4eb5-be27-17d4f071db9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.325992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee89c52-7bad-4eb5-be27-17d4f071db9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.327660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee89c52-7bad-4eb5-be27-17d4f071db9a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.339370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 808/1598] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:42.340109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee89c52-7bad-4eb5-be27-17d4f071db9a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.348038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-38b3ee0c-bb68-43f0-a760-732d0f37d4b7 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:42.349294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-38b3ee0c-bb68-43f0-a760-732d0f37d4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:42.350104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee89c52-7bad-4eb5-be27-17d4f071db9a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.354753 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cc41d-a7c9-448b-b64f-3de0dff014f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.355434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc41d-a7c9-448b-b64f-3de0dff014f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.355714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc41d-a7c9-448b-b64f-3de0dff014f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.355995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc41d-a7c9-448b-b64f-3de0dff014f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.356718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cc41d-a7c9-448b-b64f-3de0dff014f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.356998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 791/1599] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:42.360307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3ee0c-bb68-43f0-a760-732d0f37d4b7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.360418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cc41d-a7c9-448b-b64f-3de0dff014f8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.368111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3ee0c-bb68-43f0-a760-732d0f37d4b7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.372492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 809/1600] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:42.372492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cc41d-a7c9-448b-b64f-3de0dff014f8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.372990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70060890-9df7-4f34-b028-074475f7503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.373675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70060890-9df7-4f34-b028-074475f7503d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.373952 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70060890-9df7-4f34-b028-074475f7503d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.374249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70060890-9df7-4f34-b028-074475f7503d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.374978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70060890-9df7-4f34-b028-074475f7503d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.376567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70060890-9df7-4f34-b028-074475f7503d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.386835 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 792/1601] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:42.387637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70060890-9df7-4f34-b028-074475f7503d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.397435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70060890-9df7-4f34-b028-074475f7503d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.402112 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55516343-3387-456a-adc3-2e4f07bd7e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.402819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516343-3387-456a-adc3-2e4f07bd7e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.403071 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516343-3387-456a-adc3-2e4f07bd7e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.403332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516343-3387-456a-adc3-2e4f07bd7e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.404046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55516343-3387-456a-adc3-2e4f07bd7e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.405639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55516343-3387-456a-adc3-2e4f07bd7e5a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.415825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 793/1602] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:42.417124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a3294-fe81-4ac2-ace1-9c4d71015e02 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.417405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a3294-fe81-4ac2-ace1-9c4d71015e02 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.417663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a3294-fe81-4ac2-ace1-9c4d71015e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.427574 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cc41d-a7c9-448b-b64f-3de0dff014f8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.431287 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a9a02-906e-41cb-9c62-b5d169a8ec97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.431937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a9a02-906e-41cb-9c62-b5d169a8ec97 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.432213 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a9a02-906e-41cb-9c62-b5d169a8ec97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.432484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a9a02-906e-41cb-9c62-b5d169a8ec97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.435184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-226a3294-fe81-4ac2-ace1-9c4d71015e02 None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:42.436406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-226a3294-fe81-4ac2-ace1-9c4d71015e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:42.441806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a9a02-906e-41cb-9c62-b5d169a8ec97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.443469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a9a02-906e-41cb-9c62-b5d169a8ec97 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.454084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 810/1603] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:42.454902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a9a02-906e-41cb-9c62-b5d169a8ec97 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.464197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a9a02-906e-41cb-9c62-b5d169a8ec97 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.469390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da9810-bab5-493a-a781-1230478c357a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.470085 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da9810-bab5-493a-a781-1230478c357a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.470336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da9810-bab5-493a-a781-1230478c357a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.470623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da9810-bab5-493a-a781-1230478c357a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.471419 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da9810-bab5-493a-a781-1230478c357a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.473537 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da9810-bab5-493a-a781-1230478c357a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.485531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 811/1604] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:42.486751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da9810-bab5-493a-a781-1230478c357a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.496865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da9810-bab5-493a-a781-1230478c357a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.501433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60474be2-dfaf-40a7-ab8f-f32ad3a0ab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.502090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60474be2-dfaf-40a7-ab8f-f32ad3a0ab2c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.502368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60474be2-dfaf-40a7-ab8f-f32ad3a0ab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.502636 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60474be2-dfaf-40a7-ab8f-f32ad3a0ab2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.503374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60474be2-dfaf-40a7-ab8f-f32ad3a0ab2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.505165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60474be2-dfaf-40a7-ab8f-f32ad3a0ab2c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.514135 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 794/1605] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:30:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:42.514809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a3294-fe81-4ac2-ace1-9c4d71015e02 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.520720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 812/1606] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:42.521698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60474be2-dfaf-40a7-ab8f-f32ad3a0ab2c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.527528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a3294-fe81-4ac2-ace1-9c4d71015e02 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.531913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af571d87-f69a-47ed-825d-d50af4c8c737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.532620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af571d87-f69a-47ed-825d-d50af4c8c737 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.532883 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af571d87-f69a-47ed-825d-d50af4c8c737 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.533216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60474be2-dfaf-40a7-ab8f-f32ad3a0ab2c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.533346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af571d87-f69a-47ed-825d-d50af4c8c737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.538191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4d079-534f-4810-8688-1316d85aa78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.538811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4d079-534f-4810-8688-1316d85aa78f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.539090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4d079-534f-4810-8688-1316d85aa78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.539363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4d079-534f-4810-8688-1316d85aa78f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.540088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4d079-534f-4810-8688-1316d85aa78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.541787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4d079-534f-4810-8688-1316d85aa78f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.543421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af571d87-f69a-47ed-825d-d50af4c8c737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.545265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af571d87-f69a-47ed-825d-d50af4c8c737 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.556794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 813/1607] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:42.558314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4d079-534f-4810-8688-1316d85aa78f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.560320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 795/1608] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:42.561186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af571d87-f69a-47ed-825d-d50af4c8c737 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.570276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4d079-534f-4810-8688-1316d85aa78f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.571228 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af571d87-f69a-47ed-825d-d50af4c8c737 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.575465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6661190-cc55-461d-9570-7b995391c678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.576531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661190-cc55-461d-9570-7b995391c678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.576910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d489b-d076-4355-bc6f-7d0a2546c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.577057 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661190-cc55-461d-9570-7b995391c678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.577155 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661190-cc55-461d-9570-7b995391c678 admin admin] PATH_INFO: `/v3/projects/815783b3ca0c40a3a8475a811bef38fd/users/0a1c4a7e4fdc4a829b8acf762bf576c1/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.578412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d489b-d076-4355-bc6f-7d0a2546c2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.578412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d489b-d076-4355-bc6f-7d0a2546c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.578607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d489b-d076-4355-bc6f-7d0a2546c2b6 admin admin] PATH_INFO: `/v3/projects/0c6bac2fbc3342c7a8c5f9f64d0d44ea/users/eca463f83a0d4677b1c10d388ab60419/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.594121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6661190-cc55-461d-9570-7b995391c678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815783b3ca0c40a3a8475a811bef38fd, user_id=0a1c4a7e4fdc4a829b8acf762bf576c1, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.596831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6661190-cc55-461d-9570-7b995391c678 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.599431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d489b-d076-4355-bc6f-7d0a2546c2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6bac2fbc3342c7a8c5f9f64d0d44ea, user_id=eca463f83a0d4677b1c10d388ab60419, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.602946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d489b-d076-4355-bc6f-7d0a2546c2b6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.611482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 814/1609] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:42 2022] PUT /identity/v3/projects/815783b3ca0c40a3a8475a811bef38fd/users/0a1c4a7e4fdc4a829b8acf762bf576c1/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:42.612248 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6661190-cc55-461d-9570-7b995391c678 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.620766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 796/1610] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:42 2022] PUT /identity/v3/projects/0c6bac2fbc3342c7a8c5f9f64d0d44ea/users/eca463f83a0d4677b1c10d388ab60419/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:42.625008 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d489b-d076-4355-bc6f-7d0a2546c2b6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.645493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:42.696901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d489b-d076-4355-bc6f-7d0a2546c2b6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.699175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6661190-cc55-461d-9570-7b995391c678 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.701974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab27862-9fdc-4cc0-9038-d66ad4e5e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.702888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27862-9fdc-4cc0-9038-d66ad4e5e7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.703174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27862-9fdc-4cc0-9038-d66ad4e5e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.703437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27862-9fdc-4cc0-9038-d66ad4e5e7b2 admin admin] PATH_INFO: `/v3/projects/f9129daf25b24f198fe7d085b3de5185/users/24464f167d4740f5ac8405a86d0f598e/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.707152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62037392-8fa1-4a57-98cb-9aebb90306f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.708372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62037392-8fa1-4a57-98cb-9aebb90306f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.708982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62037392-8fa1-4a57-98cb-9aebb90306f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.709522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62037392-8fa1-4a57-98cb-9aebb90306f6 admin admin] PATH_INFO: `/v3/projects/1ec1b77dab7643e2b5f28806afb6efd0/users/b4c1cf09a2e0431e98dd9e9417d44ba3/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.721387 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab27862-9fdc-4cc0-9038-d66ad4e5e7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9129daf25b24f198fe7d085b3de5185, user_id=24464f167d4740f5ac8405a86d0f598e, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.724702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab27862-9fdc-4cc0-9038-d66ad4e5e7b2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.727489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62037392-8fa1-4a57-98cb-9aebb90306f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec1b77dab7643e2b5f28806afb6efd0, user_id=b4c1cf09a2e0431e98dd9e9417d44ba3, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.731219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62037392-8fa1-4a57-98cb-9aebb90306f6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.742749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 797/1611] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:42 2022] PUT /identity/v3/projects/f9129daf25b24f198fe7d085b3de5185/users/24464f167d4740f5ac8405a86d0f598e/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:42.743394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab27862-9fdc-4cc0-9038-d66ad4e5e7b2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.757276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:42.761116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 815/1612] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:42 2022] PUT /identity/v3/projects/1ec1b77dab7643e2b5f28806afb6efd0/users/b4c1cf09a2e0431e98dd9e9417d44ba3/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:42.762620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62037392-8fa1-4a57-98cb-9aebb90306f6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:42.824880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab27862-9fdc-4cc0-9038-d66ad4e5e7b2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.867671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62037392-8fa1-4a57-98cb-9aebb90306f6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:42.874178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf756a-f519-4917-aeac-a3e3e6d39f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.875086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf756a-f519-4917-aeac-a3e3e6d39f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.875365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf756a-f519-4917-aeac-a3e3e6d39f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.875637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf756a-f519-4917-aeac-a3e3e6d39f22 admin admin] PATH_INFO: `/v3/projects/d24ad9d569c7405dadf53c160977b0eb/users/54246fdf77f9409daa0d3ba70a30e8ca/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.890430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c70dd-ad19-47ea-b369-801d068a5b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:42.891104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c70dd-ad19-47ea-b369-801d068a5b68 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.891386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c70dd-ad19-47ea-b369-801d068a5b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.891670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c70dd-ad19-47ea-b369-801d068a5b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.894959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf756a-f519-4917-aeac-a3e3e6d39f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24ad9d569c7405dadf53c160977b0eb, user_id=54246fdf77f9409daa0d3ba70a30e8ca, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.897901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf756a-f519-4917-aeac-a3e3e6d39f22 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:42.914340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 816/1613] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:42 2022] PUT /identity/v3/projects/d24ad9d569c7405dadf53c160977b0eb/users/54246fdf77f9409daa0d3ba70a30e8ca/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:42.915718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ca2ab-3edb-459a-9ca5-7952395c9dd2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.916229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ca2ab-3edb-459a-9ca5-7952395c9dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.916568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ca2ab-3edb-459a-9ca5-7952395c9dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.937272 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-679ca2ab-3edb-459a-9ca5-7952395c9dd2 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:42.938437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-679ca2ab-3edb-459a-9ca5-7952395c9dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:42.982632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c70dd-ad19-47ea-b369-801d068a5b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:42.984114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c70dd-ad19-47ea-b369-801d068a5b68 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.003230 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 798/1614] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:43.006150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50944e5-21be-454b-83a1-f888aaa0f58a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.006538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50944e5-21be-454b-83a1-f888aaa0f58a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.006975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50944e5-21be-454b-83a1-f888aaa0f58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.027761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d50944e5-21be-454b-83a1-f888aaa0f58a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:43.029227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d50944e5-21be-454b-83a1-f888aaa0f58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:43.048192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 817/1615] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:43.059900 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb057c-9a81-4ff8-8314-f8840add40a9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.060183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb057c-9a81-4ff8-8314-f8840add40a9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.060468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb057c-9a81-4ff8-8314-f8840add40a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.117017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 799/1616] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:43.117017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d8359-863c-48ac-9832-97a573b6ef32 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.117017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d8359-863c-48ac-9832-97a573b6ef32 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.117522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d8359-863c-48ac-9832-97a573b6ef32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.128577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-62bb057c-9a81-4ff8-8314-f8840add40a9 None None] MFA Rules not processed for user `24464f167d4740f5ac8405a86d0f598e`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:43.129886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-62bb057c-9a81-4ff8-8314-f8840add40a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:43.134940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:43.167267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:43.171387 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ed0d8359-863c-48ac-9832-97a573b6ef32 None None] MFA Rules not processed for user `b4c1cf09a2e0431e98dd9e9417d44ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:43.181388 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ed0d8359-863c-48ac-9832-97a573b6ef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:43.280710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 818/1617] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:43.280710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06085-31ce-4c5e-ae2c-580df00cf036 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.280710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06085-31ce-4c5e-ae2c-580df00cf036 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.280710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06085-31ce-4c5e-ae2c-580df00cf036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.320406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 800/1618] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:43 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:43.325545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d8359-863c-48ac-9832-97a573b6ef32 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.325708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f7b06085-31ce-4c5e-ae2c-580df00cf036 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:43.325708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f7b06085-31ce-4c5e-ae2c-580df00cf036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:43.349047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 819/1619] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:43.350121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b06085-31ce-4c5e-ae2c-580df00cf036 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.409667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d8359-863c-48ac-9832-97a573b6ef32 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.417348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e8fd1-da2a-4d5d-b608-10790080e4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.418671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e8fd1-da2a-4d5d-b608-10790080e4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.419679 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e8fd1-da2a-4d5d-b608-10790080e4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.420239 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e8fd1-da2a-4d5d-b608-10790080e4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.447904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e8fd1-da2a-4d5d-b608-10790080e4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:43.451848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e8fd1-da2a-4d5d-b608-10790080e4d6 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.472332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b06085-31ce-4c5e-ae2c-580df00cf036 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.477799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 801/1620] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:43.478600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e8fd1-da2a-4d5d-b608-10790080e4d6 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.478736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67285e9-d010-4b40-8208-c9216cd22862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.479826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67285e9-d010-4b40-8208-c9216cd22862 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.480290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67285e9-d010-4b40-8208-c9216cd22862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.481031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67285e9-d010-4b40-8208-c9216cd22862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.502178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67285e9-d010-4b40-8208-c9216cd22862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:43.503788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67285e9-d010-4b40-8208-c9216cd22862 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.529749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 820/1621] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:43.530662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67285e9-d010-4b40-8208-c9216cd22862 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.564371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e8fd1-da2a-4d5d-b608-10790080e4d6 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.569063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad0dff-541a-47a9-815e-2115915a872f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.569555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67285e9-d010-4b40-8208-c9216cd22862 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.570093 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0dff-541a-47a9-815e-2115915a872f service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.570603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0dff-541a-47a9-815e-2115915a872f service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.570965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0dff-541a-47a9-815e-2115915a872f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.583524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d195a3d-4572-41a0-bb16-249fcb7e2ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.584251 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad0dff-541a-47a9-815e-2115915a872f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:43.586324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad0dff-541a-47a9-815e-2115915a872f service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.587013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d195a3d-4572-41a0-bb16-249fcb7e2ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.588081 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d195a3d-4572-41a0-bb16-249fcb7e2ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.589002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d195a3d-4572-41a0-bb16-249fcb7e2ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.589770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d195a3d-4572-41a0-bb16-249fcb7e2ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:43.596083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d195a3d-4572-41a0-bb16-249fcb7e2ab4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.601066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 802/1622] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:43.602252 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad0dff-541a-47a9-815e-2115915a872f service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.614148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad0dff-541a-47a9-815e-2115915a872f service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.620095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369c52e-2bd9-47d3-aab0-3c2573aedcca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.621143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369c52e-2bd9-47d3-aab0-3c2573aedcca service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.621579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369c52e-2bd9-47d3-aab0-3c2573aedcca service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.622179 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369c52e-2bd9-47d3-aab0-3c2573aedcca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.638272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369c52e-2bd9-47d3-aab0-3c2573aedcca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:43.640340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369c52e-2bd9-47d3-aab0-3c2573aedcca service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.655196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 803/1623] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:43.661279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 821/1624] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:43 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:43.662772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369c52e-2bd9-47d3-aab0-3c2573aedcca service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.676449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369c52e-2bd9-47d3-aab0-3c2573aedcca service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.719070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:43.781452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0140b4-3f53-416b-978c-50991707482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.782284 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0140b4-3f53-416b-978c-50991707482f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.782453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0140b4-3f53-416b-978c-50991707482f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.782776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0140b4-3f53-416b-978c-50991707482f admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.787201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0140b4-3f53-416b-978c-50991707482f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:43.793430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0140b4-3f53-416b-978c-50991707482f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.831551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 804/1625] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:43 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:43.836466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d195a3d-4572-41a0-bb16-249fcb7e2ab4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.871874 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d195a3d-4572-41a0-bb16-249fcb7e2ab4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.895510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f7958-24f9-40de-ad49-fecb01ac047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.899899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f7958-24f9-40de-ad49-fecb01ac047e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.904765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f7958-24f9-40de-ad49-fecb01ac047e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.906564 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f7958-24f9-40de-ad49-fecb01ac047e admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.908846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f7958-24f9-40de-ad49-fecb01ac047e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:43.918280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f7958-24f9-40de-ad49-fecb01ac047e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.944049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 822/1626] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:43.947551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0140b4-3f53-416b-978c-50991707482f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.983541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0140b4-3f53-416b-978c-50991707482f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.994345 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7358d2a-f76e-4dd1-b96c-9a5e76e8dc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.995420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358d2a-f76e-4dd1-b96c-9a5e76e8dc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.995795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358d2a-f76e-4dd1-b96c-9a5e76e8dc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.996174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358d2a-f76e-4dd1-b96c-9a5e76e8dc7c admin admin] PATH_INFO: `/v3/projects/22a698240759487f91d0ce8dfe216f32/users/0bf1881ee26a4a52bf38706eeb2b4cff/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:44.069922 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7358d2a-f76e-4dd1-b96c-9a5e76e8dc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a698240759487f91d0ce8dfe216f32, user_id=0bf1881ee26a4a52bf38706eeb2b4cff, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:44.093730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7358d2a-f76e-4dd1-b96c-9a5e76e8dc7c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:44.124777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 805/1627] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:43 2022] PUT /identity/v3/projects/22a698240759487f91d0ce8dfe216f32/users/0bf1881ee26a4a52bf38706eeb2b4cff/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:44.125074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f7958-24f9-40de-ad49-fecb01ac047e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:44.138641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f7958-24f9-40de-ad49-fecb01ac047e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:44.202438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feed069-841c-4162-af4f-d91385e76e1f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:44.203327 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feed069-841c-4162-af4f-d91385e76e1f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:44.203675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feed069-841c-4162-af4f-d91385e76e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:44.288553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8feed069-841c-4162-af4f-d91385e76e1f None None] MFA Rules not processed for user `8aa2d7827b084e949863c294a960be91`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:44.312282 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8feed069-841c-4162-af4f-d91385e76e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:44.403557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d5228-6c60-4652-97d7-514355c1a1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:44.404254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5228-6c60-4652-97d7-514355c1a1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:44.404534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5228-6c60-4652-97d7-514355c1a1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:44.408843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5228-6c60-4652-97d7-514355c1a1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:44.412096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d5228-6c60-4652-97d7-514355c1a1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:44.419924 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d5228-6c60-4652-97d7-514355c1a1d6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:44.484104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 823/1628] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:44.488085 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d5228-6c60-4652-97d7-514355c1a1d6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:44.539011 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d5228-6c60-4652-97d7-514355c1a1d6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:44.567129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255af705-3d89-4116-bb3c-c674219f14a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:44.570379 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af705-3d89-4116-bb3c-c674219f14a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:44.571928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af705-3d89-4116-bb3c-c674219f14a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:44.572494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af705-3d89-4116-bb3c-c674219f14a4 admin admin] PATH_INFO: `/v3/projects/22a698240759487f91d0ce8dfe216f32/users/0bf1881ee26a4a52bf38706eeb2b4cff/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:44.578555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255af705-3d89-4116-bb3c-c674219f14a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a698240759487f91d0ce8dfe216f32, user_id=0bf1881ee26a4a52bf38706eeb2b4cff, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:44.585438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255af705-3d89-4116-bb3c-c674219f14a4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:44.621908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 824/1629] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:44 2022] PUT /identity/v3/projects/22a698240759487f91d0ce8dfe216f32/users/0bf1881ee26a4a52bf38706eeb2b4cff/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:44.624450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 806/1630] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:30:44.629161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255af705-3d89-4116-bb3c-c674219f14a4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:44.640931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151520-439e-4ff6-8f34-4b4fc629bbc7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:44.641296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151520-439e-4ff6-8f34-4b4fc629bbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:44.641778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151520-439e-4ff6-8f34-4b4fc629bbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:44.649923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:44.736073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-15151520-439e-4ff6-8f34-4b4fc629bbc7 None None] MFA Rules not processed for user `0bf1881ee26a4a52bf38706eeb2b4cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:44.737316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-15151520-439e-4ff6-8f34-4b4fc629bbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:44.869449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255af705-3d89-4116-bb3c-c674219f14a4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:44.875967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 807/1631] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:44 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:44.889028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15151520-439e-4ff6-8f34-4b4fc629bbc7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:44.896034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f4dcf-53a9-4638-8f16-fb76ecb12649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:44.896738 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4dcf-53a9-4638-8f16-fb76ecb12649 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:44.897050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4dcf-53a9-4638-8f16-fb76ecb12649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:44.897337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4dcf-53a9-4638-8f16-fb76ecb12649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:44.898054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f4dcf-53a9-4638-8f16-fb76ecb12649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:44.900159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f4dcf-53a9-4638-8f16-fb76ecb12649 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:44.908326 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:44.973759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 825/1632] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:44 2022] POST /identity/v3/projects => generated 405 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:44.976720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9bb93-ec0f-4339-a918-d07e3340f182 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:44.976935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9bb93-ec0f-4339-a918-d07e3340f182 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:44.977347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9bb93-ec0f-4339-a918-d07e3340f182 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:44.980077 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 826/1633] 10.222.0.30 () {54 vars in 961 bytes} [Wed Jul 6 20:30:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:44.983190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9bb93-ec0f-4339-a918-d07e3340f182 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:45.067125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15151520-439e-4ff6-8f34-4b4fc629bbc7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:45.094926 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9bb93-ec0f-4339-a918-d07e3340f182 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:45.103451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a802742-c355-4bac-83b8-0b7a6aeedf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:45.105245 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a802742-c355-4bac-83b8-0b7a6aeedf82 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.106214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a802742-c355-4bac-83b8-0b7a6aeedf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.106751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a802742-c355-4bac-83b8-0b7a6aeedf82 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.107782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a802742-c355-4bac-83b8-0b7a6aeedf82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:45.109985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a802742-c355-4bac-83b8-0b7a6aeedf82 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:45.144198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 827/1634] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:44 2022] POST /identity/v3/users => generated 309 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:45.146115 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca231cd5-8562-4d33-95d6-4dee1d328f0e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.146974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca231cd5-8562-4d33-95d6-4dee1d328f0e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.147485 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca231cd5-8562-4d33-95d6-4dee1d328f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.174027 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7d13e-0067-4d17-9898-63bb345056fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:45.174428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7d13e-0067-4d17-9898-63bb345056fd service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.174708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7d13e-0067-4d17-9898-63bb345056fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.175031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7d13e-0067-4d17-9898-63bb345056fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.180941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ca231cd5-8562-4d33-95d6-4dee1d328f0e None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:45.183599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ca231cd5-8562-4d33-95d6-4dee1d328f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:45.278509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7d13e-0067-4d17-9898-63bb345056fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:45.283618 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 828/1635] 10.222.0.30 () {58 vars in 1058 bytes} [Wed Jul 6 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:45.285364 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7d13e-0067-4d17-9898-63bb345056fd service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:45.292730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca231cd5-8562-4d33-95d6-4dee1d328f0e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:45.307444 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca231cd5-8562-4d33-95d6-4dee1d328f0e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:45.314931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f90ade-257a-492a-9819-c494576406f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:45.315853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f90ade-257a-492a-9819-c494576406f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.316665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f90ade-257a-492a-9819-c494576406f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.317107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f90ade-257a-492a-9819-c494576406f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.318110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f90ade-257a-492a-9819-c494576406f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:45.318950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 808/1636] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:44 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:30:45.325644 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012dfb-7e41-41c7-bea6-f85421bf7a09 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.325975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012dfb-7e41-41c7-bea6-f85421bf7a09 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.326252 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012dfb-7e41-41c7-bea6-f85421bf7a09 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.328253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 809/1637] 10.222.0.30 () {54 vars in 912 bytes} [Wed Jul 6 20:30:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:45.330509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f90ade-257a-492a-9819-c494576406f1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:45.335146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cc2a9-cd7d-4acc-8bbe-f30903fe6272 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.335845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cc2a9-cd7d-4acc-8bbe-f30903fe6272 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.335845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cc2a9-cd7d-4acc-8bbe-f30903fe6272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.348161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:45.365464 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 829/1638] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:45.370361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f90ade-257a-492a-9819-c494576406f1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:45.394356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-108cc2a9-cd7d-4acc-8bbe-f30903fe6272 None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:45.396854 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-108cc2a9-cd7d-4acc-8bbe-f30903fe6272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:45.409360 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f90ade-257a-492a-9819-c494576406f1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:45.423789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb8745-9a14-4612-94bd-425d366d10b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:45.425410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8745-9a14-4612-94bd-425d366d10b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.427230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8745-9a14-4612-94bd-425d366d10b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.428713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8745-9a14-4612-94bd-425d366d10b8 admin admin] PATH_INFO: `/v3/projects/5e0673cd6c6b479c99f35496081a1ec0/users/56e104988a904f50bc4c616879818e5a/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.434227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 810/1639] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:30:45.464303 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cc2a9-cd7d-4acc-8bbe-f30903fe6272 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:45.478574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cc2a9-cd7d-4acc-8bbe-f30903fe6272 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:45.501513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be756d61-c132-4aae-bac7-22e604fc83f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:45.504773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be756d61-c132-4aae-bac7-22e604fc83f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.506740 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be756d61-c132-4aae-bac7-22e604fc83f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.508010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be756d61-c132-4aae-bac7-22e604fc83f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.510703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb8745-9a14-4612-94bd-425d366d10b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0673cd6c6b479c99f35496081a1ec0, user_id=56e104988a904f50bc4c616879818e5a, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:45.521043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb8745-9a14-4612-94bd-425d366d10b8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:45.535515 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be756d61-c132-4aae-bac7-22e604fc83f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:45.537995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be756d61-c132-4aae-bac7-22e604fc83f6 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:45.564457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 830/1640] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:45 2022] PUT /identity/v3/projects/5e0673cd6c6b479c99f35496081a1ec0/users/56e104988a904f50bc4c616879818e5a/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:45.566216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb8745-9a14-4612-94bd-425d366d10b8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:45.605012 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 811/1641] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:30:45.607324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be756d61-c132-4aae-bac7-22e604fc83f6 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:45.635026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be756d61-c132-4aae-bac7-22e604fc83f6 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:45.674770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb8745-9a14-4612-94bd-425d366d10b8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:45.679680 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00e5cb-c9d6-4bd9-9523-d61a00f4b61b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:45.680508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00e5cb-c9d6-4bd9-9523-d61a00f4b61b service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.680841 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00e5cb-c9d6-4bd9-9523-d61a00f4b61b service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.681168 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00e5cb-c9d6-4bd9-9523-d61a00f4b61b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.731636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:45.748719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d0452-0639-43ea-ad8c-545a7471d552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:45.751435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d0452-0639-43ea-ad8c-545a7471d552 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.751821 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d0452-0639-43ea-ad8c-545a7471d552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.752208 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d0452-0639-43ea-ad8c-545a7471d552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.754536 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d0452-0639-43ea-ad8c-545a7471d552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:45.756288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d0452-0639-43ea-ad8c-545a7471d552 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:45.784298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 812/1642] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:45.788466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d0452-0639-43ea-ad8c-545a7471d552 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:45.813601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d0452-0639-43ea-ad8c-545a7471d552 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:45.834312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4d39c-d5f7-4651-b171-eed9b3140ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:45.837220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d39c-d5f7-4651-b171-eed9b3140ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.838453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d39c-d5f7-4651-b171-eed9b3140ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.838931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d39c-d5f7-4651-b171-eed9b3140ca5 admin admin] PATH_INFO: `/v3/projects/5e0673cd6c6b479c99f35496081a1ec0/users/56e104988a904f50bc4c616879818e5a/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.843384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4d39c-d5f7-4651-b171-eed9b3140ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0673cd6c6b479c99f35496081a1ec0, user_id=56e104988a904f50bc4c616879818e5a, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:45.846659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4d39c-d5f7-4651-b171-eed9b3140ca5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:45.848355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00e5cb-c9d6-4bd9-9523-d61a00f4b61b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:45.850581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00e5cb-c9d6-4bd9-9523-d61a00f4b61b service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:45.880247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 831/1643] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:45.898676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 813/1644] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:45 2022] PUT /identity/v3/projects/5e0673cd6c6b479c99f35496081a1ec0/users/56e104988a904f50bc4c616879818e5a/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:47.086652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a1654-32f2-4fe4-a17e-4b216aac2dbb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:47.087426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a1654-32f2-4fe4-a17e-4b216aac2dbb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:47.088045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a1654-32f2-4fe4-a17e-4b216aac2dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:47.131979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1f8a1654-32f2-4fe4-a17e-4b216aac2dbb None None] MFA Rules not processed for user `56e104988a904f50bc4c616879818e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:47.133436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f8a1654-32f2-4fe4-a17e-4b216aac2dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:47.234273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 832/1645] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:48.303370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708aed8-9a0e-47d8-814a-f6831aac5ea0 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:48.303968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708aed8-9a0e-47d8-814a-f6831aac5ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:48.303968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708aed8-9a0e-47d8-814a-f6831aac5ea0 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:48.305332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 814/1646] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:48.379008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe975f2-4d66-45fc-a14c-1208822e9bf0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:48.379583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe975f2-4d66-45fc-a14c-1208822e9bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:48.379730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe975f2-4d66-45fc-a14c-1208822e9bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:48.418761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dfe975f2-4d66-45fc-a14c-1208822e9bf0 None None] MFA Rules not processed for user `e0df36a267464042908bbd8eebc7c40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:48.420175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dfe975f2-4d66-45fc-a14c-1208822e9bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:48.445562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:48.578405 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 833/1647] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:30:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:48.607061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708aed8-9a0e-47d8-814a-f6831aac5ea0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:48.628396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708aed8-9a0e-47d8-814a-f6831aac5ea0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:48.636874 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e43d7-437c-4ad4-b169-737ce6e8634d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df36a267464042908bbd8eebc7c40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:48.637750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e43d7-437c-4ad4-b169-737ce6e8634d service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:48.638513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e43d7-437c-4ad4-b169-737ce6e8634d service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:48.638513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e43d7-437c-4ad4-b169-737ce6e8634d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:48.649798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e43d7-437c-4ad4-b169-737ce6e8634d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:48.651947 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e43d7-437c-4ad4-b169-737ce6e8634d service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:48.666006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 815/1648] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:49.137484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe975f2-4d66-45fc-a14c-1208822e9bf0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:49.247529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe975f2-4d66-45fc-a14c-1208822e9bf0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:49.261046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:49.263424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:49.263424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:49.263424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] PATH_INFO: `/v3/users/8aa2d7827b084e949863c294a960be91` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:49.267062 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aa2d7827b084e949863c294a960be91)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:49.283184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:49.422835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aa2d7827b084e949863c294a960be91'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:49.457976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aa2d7827b084e949863c294a960be91'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:49.458747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aa2d7827b084e949863c294a960be91'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:49.493973 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aa2d7827b084e949863c294a960be91'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:49.527059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aa2d7827b084e949863c294a960be91'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:49.545066 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 834/1649] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:30:49 2022] DELETE /identity/v3/users/8aa2d7827b084e949863c294a960be91 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:50.107607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e43d7-437c-4ad4-b169-737ce6e8634d service placement] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:50.135921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e43d7-437c-4ad4-b169-737ce6e8634d service placement] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:50.354483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:50.355396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:50.355674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:50.356029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] PATH_INFO: `/v3/projects/53bf81c98cb74e4faad8a44f6b69e6d8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:50.357631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=53bf81c98cb74e4faad8a44f6b69e6d8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:50.359564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:50.492782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53bf81c98cb74e4faad8a44f6b69e6d8', 'request_id': 'req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:50.510400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53bf81c98cb74e4faad8a44f6b69e6d8', 'request_id': 'req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:50.520904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53bf81c98cb74e4faad8a44f6b69e6d8', 'request_id': 'req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:50.539933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] The token cache is being invalidate because project 53bf81c98cb74e4faad8a44f6b69e6d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:30:50.540596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:50.552391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:50.560237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 816/1650] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:30:50 2022] DELETE /identity/v3/projects/53bf81c98cb74e4faad8a44f6b69e6d8 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:50.561536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:50.563373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:50.595532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cef174-02dc-4cd9-af08-a60aa07edbd9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:50.688066 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:50.708023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:50.711490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:50.789810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917d0d5-5e17-4bdc-b067-4734178f67ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:50.791278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917d0d5-5e17-4bdc-b067-4734178f67ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:50.796431 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917d0d5-5e17-4bdc-b067-4734178f67ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:50.798836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917d0d5-5e17-4bdc-b067-4734178f67ff admin admin] PATH_INFO: `/v3/users/56e104988a904f50bc4c616879818e5a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:50.801856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917d0d5-5e17-4bdc-b067-4734178f67ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e104988a904f50bc4c616879818e5a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:50.805525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917d0d5-5e17-4bdc-b067-4734178f67ff admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:50.881092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:50.889951 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f6622-2e7d-4c9f-8e65-4097c7c1fc2a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:50.903382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:50.918258 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:50.918935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:50.921682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] PATH_INFO: `/v3/users/b4c1cf09a2e0431e98dd9e9417d44ba3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:50.926013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4c1cf09a2e0431e98dd9e9417d44ba3)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:50.928658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:30:50.928658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: warnings.warn(msg) Jul 06 20:30:50.928658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: Jul 06 20:30:50.932299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:50.940743 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d917d0d5-5e17-4bdc-b067-4734178f67ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e104988a904f50bc4c616879818e5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:50.977677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d917d0d5-5e17-4bdc-b067-4734178f67ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e104988a904f50bc4c616879818e5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:50.979085 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d917d0d5-5e17-4bdc-b067-4734178f67ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e104988a904f50bc4c616879818e5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:51.001686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d917d0d5-5e17-4bdc-b067-4734178f67ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e104988a904f50bc4c616879818e5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:51.017297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d917d0d5-5e17-4bdc-b067-4734178f67ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e104988a904f50bc4c616879818e5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:51.039230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 835/1651] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:30:50 2022] DELETE /identity/v3/users/56e104988a904f50bc4c616879818e5a => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:51.134239 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4c1cf09a2e0431e98dd9e9417d44ba3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:51.194020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4c1cf09a2e0431e98dd9e9417d44ba3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:51.201435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4c1cf09a2e0431e98dd9e9417d44ba3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:51.202180 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4c1cf09a2e0431e98dd9e9417d44ba3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:51.214797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4c1cf09a2e0431e98dd9e9417d44ba3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:51.273297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 817/1652] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:30:50 2022] DELETE /identity/v3/users/b4c1cf09a2e0431e98dd9e9417d44ba3 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:51.280476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad812c3-f3b3-4ad4-a8de-14e911605ae2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:51.281013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad812c3-f3b3-4ad4-a8de-14e911605ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:51.281660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad812c3-f3b3-4ad4-a8de-14e911605ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:51.345221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fad812c3-f3b3-4ad4-a8de-14e911605ae2 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:51.347773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fad812c3-f3b3-4ad4-a8de-14e911605ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:51.611367 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 836/1653] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:51.686163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:51.687998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:51.800151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fe479-a5b3-402f-9c75-44722ac37424 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:51.806331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333c080-4cd9-4ad2-9c62-98865d88151e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:51.813241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333c080-4cd9-4ad2-9c62-98865d88151e service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:51.813459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333c080-4cd9-4ad2-9c62-98865d88151e service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:51.815323 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333c080-4cd9-4ad2-9c62-98865d88151e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:51.844461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333c080-4cd9-4ad2-9c62-98865d88151e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:51.846087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333c080-4cd9-4ad2-9c62-98865d88151e service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:51.858936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 818/1654] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:52.921489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad812c3-f3b3-4ad4-a8de-14e911605ae2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:52.925455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fad812c3-f3b3-4ad4-a8de-14e911605ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:52.964188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad812c3-f3b3-4ad4-a8de-14e911605ae2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:53.000308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0987e-e9cd-4bab-b641-84990afdde97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:53.009260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0987e-e9cd-4bab-b641-84990afdde97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:53.012409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0987e-e9cd-4bab-b641-84990afdde97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:53.012729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0987e-e9cd-4bab-b641-84990afdde97 admin admin] PATH_INFO: `/v3/users/be36cfe778ac40c08f8d5c50ba26f1fb` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:53.027859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0987e-e9cd-4bab-b641-84990afdde97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be36cfe778ac40c08f8d5c50ba26f1fb)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:53.040357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0987e-e9cd-4bab-b641-84990afdde97 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:53.050890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333c080-4cd9-4ad2-9c62-98865d88151e service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:53.054475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a333c080-4cd9-4ad2-9c62-98865d88151e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:53.106232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333c080-4cd9-4ad2-9c62-98865d88151e service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:53.134351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:53.135065 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:53.135232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:53.139345 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] PATH_INFO: `/v3/projects/5e0673cd6c6b479c99f35496081a1ec0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:53.144534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0673cd6c6b479c99f35496081a1ec0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:53.163977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:53.244258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:53.252817 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a7e0987e-e9cd-4bab-b641-84990afdde97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be36cfe778ac40c08f8d5c50ba26f1fb'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:53.310563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a7e0987e-e9cd-4bab-b641-84990afdde97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be36cfe778ac40c08f8d5c50ba26f1fb'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:53.311083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a7e0987e-e9cd-4bab-b641-84990afdde97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be36cfe778ac40c08f8d5c50ba26f1fb'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:53.338009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a7e0987e-e9cd-4bab-b641-84990afdde97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be36cfe778ac40c08f8d5c50ba26f1fb'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:53.339820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0673cd6c6b479c99f35496081a1ec0', 'request_id': 'req-cd1bba0e-1938-46e6-b347-2e75edb1cc33'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:53.355639 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a7e0987e-e9cd-4bab-b641-84990afdde97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be36cfe778ac40c08f8d5c50ba26f1fb'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:53.363938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0673cd6c6b479c99f35496081a1ec0', 'request_id': 'req-cd1bba0e-1938-46e6-b347-2e75edb1cc33'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:53.378607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 837/1655] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:30:52 2022] DELETE /identity/v3/users/be36cfe778ac40c08f8d5c50ba26f1fb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:53.381760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ffc53-ad73-460d-b215-c26c37780e77 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:53.382044 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ffc53-ad73-460d-b215-c26c37780e77 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:53.386592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0673cd6c6b479c99f35496081a1ec0', 'request_id': 'req-cd1bba0e-1938-46e6-b347-2e75edb1cc33'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:53.387325 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ffc53-ad73-460d-b215-c26c37780e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:53.414569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:53.426544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] The token cache is being invalidate because project 5e0673cd6c6b479c99f35496081a1ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:30:53.430692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:53.431304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1bba0e-1938-46e6-b347-2e75edb1cc33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:53.434356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 819/1656] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:30:53 2022] DELETE /identity/v3/projects/5e0673cd6c6b479c99f35496081a1ec0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:53.440620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-057ffc53-ad73-460d-b215-c26c37780e77 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:53.444254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e167-a404-4991-a320-4533f1532196 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:53.444981 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-057ffc53-ad73-460d-b215-c26c37780e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:53.445898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e167-a404-4991-a320-4533f1532196 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:53.447117 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e167-a404-4991-a320-4533f1532196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:53.520509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-dc49e167-a404-4991-a320-4533f1532196 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:53.526259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dc49e167-a404-4991-a320-4533f1532196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:53.593237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 838/1657] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:53.625891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ffc53-ad73-460d-b215-c26c37780e77 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:53.627875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-057ffc53-ad73-460d-b215-c26c37780e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:53.712111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 820/1658] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:53.719142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cbeb5-c355-4e7d-bdc7-7c7b620762be None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:53.719750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cbeb5-c355-4e7d-bdc7-7c7b620762be None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:53.720234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cbeb5-c355-4e7d-bdc7-7c7b620762be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:53.764451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-eb8cbeb5-c355-4e7d-bdc7-7c7b620762be None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:53.770102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-eb8cbeb5-c355-4e7d-bdc7-7c7b620762be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:53.772763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ffc53-ad73-460d-b215-c26c37780e77 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:53.788147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e095f-fbb9-478a-a44c-851c4b7e81f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:53.789093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e095f-fbb9-478a-a44c-851c4b7e81f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:53.791095 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e095f-fbb9-478a-a44c-851c4b7e81f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:53.791403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e095f-fbb9-478a-a44c-851c4b7e81f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:53.793129 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 821/1659] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:30:53.797222 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cbeb5-c355-4e7d-bdc7-7c7b620762be None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:53.822954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e095f-fbb9-478a-a44c-851c4b7e81f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:53.824738 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e095f-fbb9-478a-a44c-851c4b7e81f1 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:53.837710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cbeb5-c355-4e7d-bdc7-7c7b620762be None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:53.845868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 839/1660] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:30:53.855997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31bb77-bd66-477b-a096-1e1dbaf8861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:53.868889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31bb77-bd66-477b-a096-1e1dbaf8861a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:53.870986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31bb77-bd66-477b-a096-1e1dbaf8861a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:53.872730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31bb77-bd66-477b-a096-1e1dbaf8861a admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:53.878249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31bb77-bd66-477b-a096-1e1dbaf8861a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:53.879316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31bb77-bd66-477b-a096-1e1dbaf8861a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:53.884821 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31bb77-bd66-477b-a096-1e1dbaf8861a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:53.945019 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 822/1661] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:53.949784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e095f-fbb9-478a-a44c-851c4b7e81f1 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:53.960767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e095f-fbb9-478a-a44c-851c4b7e81f1 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:53.977902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e1440-effd-4b35-a43f-643089657a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:53.978583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e1440-effd-4b35-a43f-643089657a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:53.978864 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e1440-effd-4b35-a43f-643089657a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:53.979392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e1440-effd-4b35-a43f-643089657a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:53.980561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e1440-effd-4b35-a43f-643089657a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:53.985473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e1440-effd-4b35-a43f-643089657a8f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:54.052641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31bb77-bd66-477b-a096-1e1dbaf8861a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:54.061707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 840/1662] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:53 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:54.069715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31bb77-bd66-477b-a096-1e1dbaf8861a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:54.331517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c670df-e89f-4129-86e3-2485f0fa8cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:54.333637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c670df-e89f-4129-86e3-2485f0fa8cec admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:54.335324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c670df-e89f-4129-86e3-2485f0fa8cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:54.335855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c670df-e89f-4129-86e3-2485f0fa8cec admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:54.338451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c670df-e89f-4129-86e3-2485f0fa8cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:54.354508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c670df-e89f-4129-86e3-2485f0fa8cec admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:54.383093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e1440-effd-4b35-a43f-643089657a8f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:54.388816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9b0e1440-effd-4b35-a43f-643089657a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:54.418064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 823/1663] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:54 2022] POST /identity/v3/users => generated 291 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:54.419044 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e1440-effd-4b35-a43f-643089657a8f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:54.419183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c670df-e89f-4129-86e3-2485f0fa8cec admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:54.434610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:54.435762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:54.436266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:54.436834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] PATH_INFO: `/v3/projects/1ec1b77dab7643e2b5f28806afb6efd0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:54.440596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec1b77dab7643e2b5f28806afb6efd0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:54.441939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: WARNING py.warnings [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:30:54.441939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: warnings.warn(msg) Jul 06 20:30:54.441939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: Jul 06 20:30:54.445982 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c670df-e89f-4129-86e3-2485f0fa8cec admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:54.447729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:54.459498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdadfea-3557-41ab-8de9-1638f99821c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:54.463403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdadfea-3557-41ab-8de9-1638f99821c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:54.463696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdadfea-3557-41ab-8de9-1638f99821c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:54.465841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdadfea-3557-41ab-8de9-1638f99821c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:54.467452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdadfea-3557-41ab-8de9-1638f99821c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:54.474303 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdadfea-3557-41ab-8de9-1638f99821c9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:54.506049 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 824/1664] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:54.511591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdadfea-3557-41ab-8de9-1638f99821c9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:54.537764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdadfea-3557-41ab-8de9-1638f99821c9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:54.546577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606f89c-3b73-4028-bc5b-ae5950fa0c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:54.547270 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606f89c-3b73-4028-bc5b-ae5950fa0c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:54.547551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606f89c-3b73-4028-bc5b-ae5950fa0c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:54.547821 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606f89c-3b73-4028-bc5b-ae5950fa0c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:54.548564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606f89c-3b73-4028-bc5b-ae5950fa0c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:54.561039 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606f89c-3b73-4028-bc5b-ae5950fa0c1b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:54.574022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:54.589067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 825/1665] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:54.595721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606f89c-3b73-4028-bc5b-ae5950fa0c1b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:54.606613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec1b77dab7643e2b5f28806afb6efd0', 'request_id': 'req-f158c2aa-c5fe-469f-a5a8-44dbf545c273'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:54.625488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec1b77dab7643e2b5f28806afb6efd0', 'request_id': 'req-f158c2aa-c5fe-469f-a5a8-44dbf545c273'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:54.638583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606f89c-3b73-4028-bc5b-ae5950fa0c1b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:54.642428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec1b77dab7643e2b5f28806afb6efd0', 'request_id': 'req-f158c2aa-c5fe-469f-a5a8-44dbf545c273'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:54.693093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] The token cache is being invalidate because project 1ec1b77dab7643e2b5f28806afb6efd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:30:54.693455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:54.697052 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:54.703489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 841/1666] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:30:54 2022] DELETE /identity/v3/projects/1ec1b77dab7643e2b5f28806afb6efd0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:54.706642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:54.708577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:54.842171 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:54.887194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4010c71-f2b6-40c5-9c9c-b2d8c06400ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:54.888895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158c2aa-c5fe-469f-a5a8-44dbf545c273 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:54.890261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4010c71-f2b6-40c5-9c9c-b2d8c06400ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:54.890782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4010c71-f2b6-40c5-9c9c-b2d8c06400ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:54.892470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4010c71-f2b6-40c5-9c9c-b2d8c06400ba admin admin] PATH_INFO: `/v3/projects/a20eefafd7b446be82be8f470dbc86d0/users/391e8942fac246ee86d4734288fe369b/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:54.900549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:54.901787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:54.904357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:54.905062 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] PATH_INFO: `/v3/users/0bf1881ee26a4a52bf38706eeb2b4cff` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:54.909852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf1881ee26a4a52bf38706eeb2b4cff)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:54.915360 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:54.931798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4010c71-f2b6-40c5-9c9c-b2d8c06400ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20eefafd7b446be82be8f470dbc86d0, user_id=391e8942fac246ee86d4734288fe369b, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:54.935871 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4010c71-f2b6-40c5-9c9c-b2d8c06400ba admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:54.972791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 826/1667] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:54 2022] PUT /identity/v3/projects/a20eefafd7b446be82be8f470dbc86d0/users/391e8942fac246ee86d4734288fe369b/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:54.985720 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2bf79-503e-4cc1-af55-6fcb3d3fd2ca None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:54.986013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2bf79-503e-4cc1-af55-6fcb3d3fd2ca None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:54.986229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2bf79-503e-4cc1-af55-6fcb3d3fd2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:55.042325 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf1881ee26a4a52bf38706eeb2b4cff'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:55.063011 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a7c2bf79-503e-4cc1-af55-6fcb3d3fd2ca None None] MFA Rules not processed for user `391e8942fac246ee86d4734288fe369b`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:55.069558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a7c2bf79-503e-4cc1-af55-6fcb3d3fd2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:55.080852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf1881ee26a4a52bf38706eeb2b4cff'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:55.082160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf1881ee26a4a52bf38706eeb2b4cff'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:55.099003 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf1881ee26a4a52bf38706eeb2b4cff'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:55.121140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf1881ee26a4a52bf38706eeb2b4cff'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:55.139759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 842/1668] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:30:54 2022] DELETE /identity/v3/users/0bf1881ee26a4a52bf38706eeb2b4cff => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:55.196064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 827/1669] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:30:55.200850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:55.204122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:55.309124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:55.329548 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a3411-b46e-42cd-84f2-b46d761c2c8a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:55.339948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c96421-2faf-440d-8b55-36ea78c06401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:55.340811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c96421-2faf-440d-8b55-36ea78c06401 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:55.341672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c96421-2faf-440d-8b55-36ea78c06401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:55.341965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c96421-2faf-440d-8b55-36ea78c06401 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:55.342703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c96421-2faf-440d-8b55-36ea78c06401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:55.344689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c96421-2faf-440d-8b55-36ea78c06401 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:55.417525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 843/1670] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:55 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:55.419272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2bf79-503e-4cc1-af55-6fcb3d3fd2ca None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:55.602578 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2bf79-503e-4cc1-af55-6fcb3d3fd2ca None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:55.800683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93565df-21a4-4ef0-8641-766992a22fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:55.801217 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93565df-21a4-4ef0-8641-766992a22fab admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:55.801495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93565df-21a4-4ef0-8641-766992a22fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:55.801766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93565df-21a4-4ef0-8641-766992a22fab admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:55.802478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93565df-21a4-4ef0-8641-766992a22fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:55.805515 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93565df-21a4-4ef0-8641-766992a22fab admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:55.870109 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:55.883429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 828/1671] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:55 2022] POST /identity/v3/users => generated 297 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:55.887940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c96421-2faf-440d-8b55-36ea78c06401 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:55.906583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c96421-2faf-440d-8b55-36ea78c06401 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:55.922277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7d63d-70fc-47fc-8c4c-d50eacc1bb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:55.922989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7d63d-70fc-47fc-8c4c-d50eacc1bb85 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:55.923430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7d63d-70fc-47fc-8c4c-d50eacc1bb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:55.923597 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7d63d-70fc-47fc-8c4c-d50eacc1bb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:55.924305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7d63d-70fc-47fc-8c4c-d50eacc1bb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:55.932790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7d63d-70fc-47fc-8c4c-d50eacc1bb85 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:55.974415 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93565df-21a4-4ef0-8641-766992a22fab admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:55.987864 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 844/1672] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:55.988661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93565df-21a4-4ef0-8641-766992a22fab admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:56.015050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37b699-96b4-4e4a-8189-9644fe3f4642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:56.016668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37b699-96b4-4e4a-8189-9644fe3f4642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:56.017247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37b699-96b4-4e4a-8189-9644fe3f4642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:56.018891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37b699-96b4-4e4a-8189-9644fe3f4642 admin admin] PATH_INFO: `/v3/projects/6b32b333c6224f10874b32396c02cc97/users/bb08c57cf33847efb27b297e896f1d6a/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:56.075696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37b699-96b4-4e4a-8189-9644fe3f4642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b32b333c6224f10874b32396c02cc97, user_id=bb08c57cf33847efb27b297e896f1d6a, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:56.078643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37b699-96b4-4e4a-8189-9644fe3f4642 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:56.112996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 829/1673] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:55 2022] PUT /identity/v3/projects/6b32b333c6224f10874b32396c02cc97/users/bb08c57cf33847efb27b297e896f1d6a/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:30:56.118971 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7d63d-70fc-47fc-8c4c-d50eacc1bb85 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:56.155035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7d63d-70fc-47fc-8c4c-d50eacc1bb85 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:56.342224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f8dbb-5fa2-4ba3-9fc2-7ad8e4d56356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:56.344046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f8dbb-5fa2-4ba3-9fc2-7ad8e4d56356 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:56.344440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f8dbb-5fa2-4ba3-9fc2-7ad8e4d56356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:56.344599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f8dbb-5fa2-4ba3-9fc2-7ad8e4d56356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:56.345524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f8dbb-5fa2-4ba3-9fc2-7ad8e4d56356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:56.347289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f8dbb-5fa2-4ba3-9fc2-7ad8e4d56356 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:56.378080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37b699-96b4-4e4a-8189-9644fe3f4642 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:56.385877 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ee37b699-96b4-4e4a-8189-9644fe3f4642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:56.396389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 845/1674] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:56.397581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f8dbb-5fa2-4ba3-9fc2-7ad8e4d56356 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:56.434596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f8dbb-5fa2-4ba3-9fc2-7ad8e4d56356 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:56.446266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37b699-96b4-4e4a-8189-9644fe3f4642 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:56.469244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a744113-00ec-43a1-acba-9626caa1bde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:56.470173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a744113-00ec-43a1-acba-9626caa1bde0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:56.470455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a744113-00ec-43a1-acba-9626caa1bde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:56.470642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:56.470758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a744113-00ec-43a1-acba-9626caa1bde0 admin admin] PATH_INFO: `/v3/projects/6b32b333c6224f10874b32396c02cc97/users/bb08c57cf33847efb27b297e896f1d6a/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:56.472771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:56.474913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:56.475430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] PATH_INFO: `/v3/projects/fa6fd781857e4438bf3a3874260a38c4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:56.478215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a744113-00ec-43a1-acba-9626caa1bde0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b32b333c6224f10874b32396c02cc97, user_id=bb08c57cf33847efb27b297e896f1d6a, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:56.480823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa6fd781857e4438bf3a3874260a38c4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:56.481990 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a744113-00ec-43a1-acba-9626caa1bde0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:56.493889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:56.550597 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 846/1675] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:56 2022] PUT /identity/v3/projects/6b32b333c6224f10874b32396c02cc97/users/bb08c57cf33847efb27b297e896f1d6a/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:56.551845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b63d6b-6ad1-44fc-9879-015b0b9ee3b7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:56.552451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b63d6b-6ad1-44fc-9879-015b0b9ee3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:56.552994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b63d6b-6ad1-44fc-9879-015b0b9ee3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:56.635778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f9b63d6b-6ad1-44fc-9879-015b0b9ee3b7 None None] MFA Rules not processed for user `3c50cd073cfa45bc9dc52dc65bf7e945`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:56.643192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f9b63d6b-6ad1-44fc-9879-015b0b9ee3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:56.649248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6fd781857e4438bf3a3874260a38c4', 'request_id': 'req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:56.673008 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6fd781857e4438bf3a3874260a38c4', 'request_id': 'req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:56.679950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6fd781857e4438bf3a3874260a38c4', 'request_id': 'req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:56.724197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] The token cache is being invalidate because project fa6fd781857e4438bf3a3874260a38c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:30:56.724490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:56.729577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a63e8f9-e2eb-4565-8594-f12f51f31fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:56.732760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 830/1676] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:30:56 2022] DELETE /identity/v3/projects/fa6fd781857e4438bf3a3874260a38c4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:56.745211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236f4a0-1335-45e6-b7e1-f00848785304 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:56.745543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236f4a0-1335-45e6-b7e1-f00848785304 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:56.745805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236f4a0-1335-45e6-b7e1-f00848785304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:56.839574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a236f4a0-1335-45e6-b7e1-f00848785304 None None] MFA Rules not processed for user `bb08c57cf33847efb27b297e896f1d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:56.840817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a236f4a0-1335-45e6-b7e1-f00848785304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:56.858779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 847/1677] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:56.860158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83400c51-dad3-4b03-83c4-65b4933430a2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:56.860509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83400c51-dad3-4b03-83c4-65b4933430a2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:56.860712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83400c51-dad3-4b03-83c4-65b4933430a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:56.944053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-83400c51-dad3-4b03-83c4-65b4933430a2 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:56.947476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-83400c51-dad3-4b03-83c4-65b4933430a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:57.052017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 831/1678] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:57.052546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236f4a0-1335-45e6-b7e1-f00848785304 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:57.053936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a236f4a0-1335-45e6-b7e1-f00848785304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:57.067693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:57.174311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 848/1679] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:57.176396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83400c51-dad3-4b03-83c4-65b4933430a2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:57.177819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-83400c51-dad3-4b03-83c4-65b4933430a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:57.222645 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:57.288567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236f4a0-1335-45e6-b7e1-f00848785304 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:57.303802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:57.304736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:57.304990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:57.305318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] PATH_INFO: `/v3/projects/22a698240759487f91d0ce8dfe216f32` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:57.310197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a698240759487f91d0ce8dfe216f32)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:57.312334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:57.426211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83400c51-dad3-4b03-83c4-65b4933430a2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:57.493761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a698240759487f91d0ce8dfe216f32', 'request_id': 'req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:57.523487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a698240759487f91d0ce8dfe216f32', 'request_id': 'req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:57.545865 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a698240759487f91d0ce8dfe216f32', 'request_id': 'req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:57.572374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] The token cache is being invalidate because project 22a698240759487f91d0ce8dfe216f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:30:57.572674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:57.574430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:57.578159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 832/1680] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:30:57 2022] DELETE /identity/v3/projects/22a698240759487f91d0ce8dfe216f32 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:57.579187 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:57.588655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:57.746262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f38346-a6f0-4476-8681-ad67ae2a420c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:57.747623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38346-a6f0-4476-8681-ad67ae2a420c service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:57.748057 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38346-a6f0-4476-8681-ad67ae2a420c service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:57.749215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38346-a6f0-4476-8681-ad67ae2a420c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:57.756974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-74f38346-a6f0-4476-8681-ad67ae2a420c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:57.813820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7323967-d5fb-42d1-9737-5fdcc1a7dcb7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:57.844143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039ca3-1b03-4737-85d2-4f88587cd908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:57.844909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039ca3-1b03-4737-85d2-4f88587cd908 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:57.845223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039ca3-1b03-4737-85d2-4f88587cd908 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:57.845494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039ca3-1b03-4737-85d2-4f88587cd908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:57.853821 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3c039ca3-1b03-4737-85d2-4f88587cd908 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:57.909279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f38346-a6f0-4476-8681-ad67ae2a420c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:57.911647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f38346-a6f0-4476-8681-ad67ae2a420c service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:57.926071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 849/1681] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:57.927792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407acb-75fa-4ff0-bc22-9eec1091786a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:57.928045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407acb-75fa-4ff0-bc22-9eec1091786a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:57.928637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407acb-75fa-4ff0-bc22-9eec1091786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:57.955567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fa407acb-75fa-4ff0-bc22-9eec1091786a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:57.961322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fa407acb-75fa-4ff0-bc22-9eec1091786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:57.964485 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:58.136880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 850/1682] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:58.146834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564983e5-5fb8-45c5-b587-b27b20065d7c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:58.147133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564983e5-5fb8-45c5-b587-b27b20065d7c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:58.147414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564983e5-5fb8-45c5-b587-b27b20065d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:58.149872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c039ca3-1b03-4737-85d2-4f88587cd908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:58.154313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c039ca3-1b03-4737-85d2-4f88587cd908 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:58.192646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 833/1683] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:58.193563 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039ca3-1b03-4737-85d2-4f88587cd908 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:58.206858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-564983e5-5fb8-45c5-b587-b27b20065d7c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:58.208202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-564983e5-5fb8-45c5-b587-b27b20065d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:58.219457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039ca3-1b03-4737-85d2-4f88587cd908 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:58.232615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f013e69-7b87-46d2-8301-fc5c647829b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:58.238694 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f013e69-7b87-46d2-8301-fc5c647829b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:58.238907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f013e69-7b87-46d2-8301-fc5c647829b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:58.239142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f013e69-7b87-46d2-8301-fc5c647829b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:58.239971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f013e69-7b87-46d2-8301-fc5c647829b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:58.243346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f013e69-7b87-46d2-8301-fc5c647829b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:58.244252 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f013e69-7b87-46d2-8301-fc5c647829b8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:58.246142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 851/1684] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:58.255692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef735-7381-446d-a772-149378a87502 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:58.256255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef735-7381-446d-a772-149378a87502 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:58.256763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef735-7381-446d-a772-149378a87502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:58.305610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-797ef735-7381-446d-a772-149378a87502 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:58.310063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-797ef735-7381-446d-a772-149378a87502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:58.311087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 834/1685] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:58.315698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f013e69-7b87-46d2-8301-fc5c647829b8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:58.353610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f013e69-7b87-46d2-8301-fc5c647829b8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:58.357251 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 852/1686] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:58.361197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef735-7381-446d-a772-149378a87502 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:58.367666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee6a23-7cc7-49ac-ade3-26154bc07b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:58.369015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee6a23-7cc7-49ac-ade3-26154bc07b4e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:58.369297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee6a23-7cc7-49ac-ade3-26154bc07b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:58.369592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee6a23-7cc7-49ac-ade3-26154bc07b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:58.370309 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee6a23-7cc7-49ac-ade3-26154bc07b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:58.375746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee6a23-7cc7-49ac-ade3-26154bc07b4e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:58.393113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:58.401602 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef735-7381-446d-a772-149378a87502 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:58.417414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a25eb-9cdf-4caf-aae7-a01eec307cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:58.418118 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a25eb-9cdf-4caf-aae7-a01eec307cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:58.418403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a25eb-9cdf-4caf-aae7-a01eec307cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:58.418755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a25eb-9cdf-4caf-aae7-a01eec307cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:58.423778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-753a25eb-9cdf-4caf-aae7-a01eec307cb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:58.498811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 835/1687] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:58 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:58.502274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee6a23-7cc7-49ac-ade3-26154bc07b4e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:58.586312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a25eb-9cdf-4caf-aae7-a01eec307cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:58.588253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a25eb-9cdf-4caf-aae7-a01eec307cb2 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:58.605098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 853/1688] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:30:58.606041 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a25eb-9cdf-4caf-aae7-a01eec307cb2 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:58.637380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a25eb-9cdf-4caf-aae7-a01eec307cb2 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:58.795507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ced1-751b-4791-b1b7-d3ffaa1569e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:58.796216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ced1-751b-4791-b1b7-d3ffaa1569e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:58.797202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ced1-751b-4791-b1b7-d3ffaa1569e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:58.797202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ced1-751b-4791-b1b7-d3ffaa1569e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:58.798972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789ced1-751b-4791-b1b7-d3ffaa1569e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:58.799933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789ced1-751b-4791-b1b7-d3ffaa1569e5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:58.825942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee6a23-7cc7-49ac-ade3-26154bc07b4e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:58.853148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc354d0f-25ce-4d8f-8c3a-f2a1ac0c25a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:58.865034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 854/1689] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:58 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:58.866494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ced1-751b-4791-b1b7-d3ffaa1569e5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:58.872859 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354d0f-25ce-4d8f-8c3a-f2a1ac0c25a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:58.873207 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354d0f-25ce-4d8f-8c3a-f2a1ac0c25a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:58.873505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354d0f-25ce-4d8f-8c3a-f2a1ac0c25a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:58.881676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc354d0f-25ce-4d8f-8c3a-f2a1ac0c25a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:58.882880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc354d0f-25ce-4d8f-8c3a-f2a1ac0c25a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:58.885835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ced1-751b-4791-b1b7-d3ffaa1569e5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:58.892109 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc354d0f-25ce-4d8f-8c3a-f2a1ac0c25a4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:58.902468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19999b26-e833-489b-a5fb-753ded635bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:58.903170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19999b26-e833-489b-a5fb-753ded635bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:58.903507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19999b26-e833-489b-a5fb-753ded635bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:58.903781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19999b26-e833-489b-a5fb-753ded635bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:58.904534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19999b26-e833-489b-a5fb-753ded635bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:58.906224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19999b26-e833-489b-a5fb-753ded635bc4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:58.940042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 855/1690] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:30:58.943304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19999b26-e833-489b-a5fb-753ded635bc4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:58.947516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-19999b26-e833-489b-a5fb-753ded635bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:58.978300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 836/1691] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:58.979789 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc354d0f-25ce-4d8f-8c3a-f2a1ac0c25a4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:59.000060 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19999b26-e833-489b-a5fb-753ded635bc4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:59.017930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:59.019100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:59.019693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:59.020107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] PATH_INFO: `/v3/users/24464f167d4740f5ac8405a86d0f598e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:59.021437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc354d0f-25ce-4d8f-8c3a-f2a1ac0c25a4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:59.021982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24464f167d4740f5ac8405a86d0f598e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:59.024569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:59.043037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166ae81-6bd3-4fee-8a0f-92a78d85d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:59.043786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ae81-6bd3-4fee-8a0f-92a78d85d487 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:59.044068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ae81-6bd3-4fee-8a0f-92a78d85d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:59.044353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ae81-6bd3-4fee-8a0f-92a78d85d487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:59.045127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166ae81-6bd3-4fee-8a0f-92a78d85d487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:59.045697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:59.046810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166ae81-6bd3-4fee-8a0f-92a78d85d487 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:59.103447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 837/1692] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:30:59.103447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166ae81-6bd3-4fee-8a0f-92a78d85d487 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:59.152163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24464f167d4740f5ac8405a86d0f598e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:59.170352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166ae81-6bd3-4fee-8a0f-92a78d85d487 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:59.193795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24464f167d4740f5ac8405a86d0f598e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:59.194596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24464f167d4740f5ac8405a86d0f598e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:59.198068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5f954-62bf-48ec-b91a-33f93ffb6feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:59.201594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f954-62bf-48ec-b91a-33f93ffb6feb admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:59.202562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f954-62bf-48ec-b91a-33f93ffb6feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:59.203752 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f954-62bf-48ec-b91a-33f93ffb6feb admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:59.205663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5f954-62bf-48ec-b91a-33f93ffb6feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:59.208850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5f954-62bf-48ec-b91a-33f93ffb6feb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:59.212395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24464f167d4740f5ac8405a86d0f598e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:59.228562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24464f167d4740f5ac8405a86d0f598e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:30:59.268320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 856/1693] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:30:58 2022] DELETE /identity/v3/users/24464f167d4740f5ac8405a86d0f598e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:59.270619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:59.274406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:59.295280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 838/1694] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:30:59 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:59.297294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2f29c-887e-46f5-8af1-461e3dec5b4d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:59.297814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2f29c-887e-46f5-8af1-461e3dec5b4d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:59.301630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2f29c-887e-46f5-8af1-461e3dec5b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:59.346487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a3c2f29c-887e-46f5-8af1-461e3dec5b4d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:59.357487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a3c2f29c-887e-46f5-8af1-461e3dec5b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:59.472105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13f36c-e494-4502-886a-7b94d3f65d61 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:59.529730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 839/1695] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:30:59.540781 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2f29c-887e-46f5-8af1-461e3dec5b4d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:59.544491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a3c2f29c-887e-46f5-8af1-461e3dec5b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:59.572193 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2f29c-887e-46f5-8af1-461e3dec5b4d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:59.598478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098dafd-2e1a-40bb-94c6-838b0e94a55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:59.599190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098dafd-2e1a-40bb-94c6-838b0e94a55d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:59.599467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098dafd-2e1a-40bb-94c6-838b0e94a55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:59.599738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098dafd-2e1a-40bb-94c6-838b0e94a55d admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:59.600451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098dafd-2e1a-40bb-94c6-838b0e94a55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:59.602521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098dafd-2e1a-40bb-94c6-838b0e94a55d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:59.666185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 840/1696] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:30:59 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:59.673410 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098dafd-2e1a-40bb-94c6-838b0e94a55d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:59.677281 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4393d1-8785-46d6-8e14-be6f94f203b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:59.678314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c098dafd-2e1a-40bb-94c6-838b0e94a55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:59.680699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4393d1-8785-46d6-8e14-be6f94f203b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:59.681435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4393d1-8785-46d6-8e14-be6f94f203b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:59.682053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4393d1-8785-46d6-8e14-be6f94f203b2 admin admin] PATH_INFO: `/v3/projects/1fe4497fad8b463bb6e8bfcacf4aecfe/users/400a0870a75e43ec93596153f6b0604f/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:59.730135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4393d1-8785-46d6-8e14-be6f94f203b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe4497fad8b463bb6e8bfcacf4aecfe, user_id=400a0870a75e43ec93596153f6b0604f, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:59.733757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4393d1-8785-46d6-8e14-be6f94f203b2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:59.778794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 857/1697] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:30:59 2022] PUT /identity/v3/projects/1fe4497fad8b463bb6e8bfcacf4aecfe/users/400a0870a75e43ec93596153f6b0604f/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:59.780596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4393d1-8785-46d6-8e14-be6f94f203b2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:59.801136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:59.856045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:59.886024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098dafd-2e1a-40bb-94c6-838b0e94a55d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:59.996664 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4393d1-8785-46d6-8e14-be6f94f203b2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:00.015375 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f26e2-e09e-45c1-a4a2-8b17ebb21283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:00.017129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f26e2-e09e-45c1-a4a2-8b17ebb21283 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:00.017394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f26e2-e09e-45c1-a4a2-8b17ebb21283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:00.017667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f26e2-e09e-45c1-a4a2-8b17ebb21283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:00.018420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f26e2-e09e-45c1-a4a2-8b17ebb21283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:00.029389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f26e2-e09e-45c1-a4a2-8b17ebb21283 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:00.030866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d0707-1b74-475b-9a4d-06fc2481f324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:00.032680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d0707-1b74-475b-9a4d-06fc2481f324 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:00.033047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d0707-1b74-475b-9a4d-06fc2481f324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:00.033261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d0707-1b74-475b-9a4d-06fc2481f324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:00.067420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 858/1698] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:00.069463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d0707-1b74-475b-9a4d-06fc2481f324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:00.070936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5287-9ec7-452b-af5b-c55e9dd9e4c8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:00.072442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5287-9ec7-452b-af5b-c55e9dd9e4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:00.072442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5287-9ec7-452b-af5b-c55e9dd9e4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:00.072825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d0707-1b74-475b-9a4d-06fc2481f324 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:00.106304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 841/1699] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:00.108343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d0707-1b74-475b-9a4d-06fc2481f324 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:00.148124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d0707-1b74-475b-9a4d-06fc2481f324 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:00.151094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6b9f5287-9ec7-452b-af5b-c55e9dd9e4c8 None None] MFA Rules not processed for user `400a0870a75e43ec93596153f6b0604f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:00.160759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aefb00-6c11-4856-86db-62afc8d5dda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:00.160999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6b9f5287-9ec7-452b-af5b-c55e9dd9e4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:00.162743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aefb00-6c11-4856-86db-62afc8d5dda1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:00.163189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aefb00-6c11-4856-86db-62afc8d5dda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:00.163595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aefb00-6c11-4856-86db-62afc8d5dda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:00.164621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aefb00-6c11-4856-86db-62afc8d5dda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:00.167176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aefb00-6c11-4856-86db-62afc8d5dda1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:00.186634 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 842/1700] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:00.190462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aefb00-6c11-4856-86db-62afc8d5dda1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:00.210534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aefb00-6c11-4856-86db-62afc8d5dda1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:00.223672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12806b-af56-4980-b47f-33cc301c9591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:00.228760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12806b-af56-4980-b47f-33cc301c9591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:00.229093 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12806b-af56-4980-b47f-33cc301c9591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:00.229373 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12806b-af56-4980-b47f-33cc301c9591 admin admin] PATH_INFO: `/v3/projects/dbeb76fefa9f40ff8aa7cc78fea309bd/users/84ae7d2552354c9b9b5ca55933e48fa5/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:00.283156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12806b-af56-4980-b47f-33cc301c9591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbeb76fefa9f40ff8aa7cc78fea309bd, user_id=84ae7d2552354c9b9b5ca55933e48fa5, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:00.287176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12806b-af56-4980-b47f-33cc301c9591 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:00.310097 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 859/1701] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:00.316067 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f5287-9ec7-452b-af5b-c55e9dd9e4c8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:00.319502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 843/1702] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:00 2022] PUT /identity/v3/projects/dbeb76fefa9f40ff8aa7cc78fea309bd/users/84ae7d2552354c9b9b5ca55933e48fa5/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:00.329365 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4888-b533-4c75-9b10-e78e1e079dbb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:00.330428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4888-b533-4c75-9b10-e78e1e079dbb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:00.330428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4888-b533-4c75-9b10-e78e1e079dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:00.341947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f5287-9ec7-452b-af5b-c55e9dd9e4c8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:00.408560 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-810a4888-b533-4c75-9b10-e78e1e079dbb None None] MFA Rules not processed for user `84ae7d2552354c9b9b5ca55933e48fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:00.412206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-810a4888-b533-4c75-9b10-e78e1e079dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:00.631136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa9934-b65d-4c53-a090-d1f5c6e97dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:00.631855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa9934-b65d-4c53-a090-d1f5c6e97dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:00.632142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa9934-b65d-4c53-a090-d1f5c6e97dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:00.632911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa9934-b65d-4c53-a090-d1f5c6e97dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:00.642314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa9934-b65d-4c53-a090-d1f5c6e97dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:00.647374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa9934-b65d-4c53-a090-d1f5c6e97dc4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:00.670480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 844/1703] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:00.674179 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a4888-b533-4c75-9b10-e78e1e079dbb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:00.719993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a4888-b533-4c75-9b10-e78e1e079dbb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:00.730889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e2759-dea3-4a86-a6b5-17d9dde07de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:00.733082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2759-dea3-4a86-a6b5-17d9dde07de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:00.734296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2759-dea3-4a86-a6b5-17d9dde07de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:00.735458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2759-dea3-4a86-a6b5-17d9dde07de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:00.737475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e2759-dea3-4a86-a6b5-17d9dde07de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:00.746818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e2759-dea3-4a86-a6b5-17d9dde07de8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:00.793904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 860/1704] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:00 2022] POST /identity/v3/projects => generated 377 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:00.798708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa9934-b65d-4c53-a090-d1f5c6e97dc4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:00.851480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 845/1705] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:00 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:00.855366 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e2759-dea3-4a86-a6b5-17d9dde07de8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:00.923965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:00.952431 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:01.085194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e2759-dea3-4a86-a6b5-17d9dde07de8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:01.108131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f9d8d-d584-4f27-8f5c-4ce258a81ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:01.114900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f9d8d-d584-4f27-8f5c-4ce258a81ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:01.128747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa9934-b65d-4c53-a090-d1f5c6e97dc4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:01.147130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f9d8d-d584-4f27-8f5c-4ce258a81ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:01.148694 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f9d8d-d584-4f27-8f5c-4ce258a81ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:01.150223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f9d8d-d584-4f27-8f5c-4ce258a81ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:01.189934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f9d8d-d584-4f27-8f5c-4ce258a81ef1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:01.197589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e0c52-54a6-4e80-a5f4-a30e4d3cf339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:01.202192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e0c52-54a6-4e80-a5f4-a30e4d3cf339 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:01.202484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e0c52-54a6-4e80-a5f4-a30e4d3cf339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:01.202766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e0c52-54a6-4e80-a5f4-a30e4d3cf339 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:01.203557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e0c52-54a6-4e80-a5f4-a30e4d3cf339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:01.220318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e0c52-54a6-4e80-a5f4-a30e4d3cf339 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:01.374783 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 846/1706] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:00 2022] POST /identity/v3/users => generated 292 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:01.379006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f9d8d-d584-4f27-8f5c-4ce258a81ef1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:01.405406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 861/1707] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:00 2022] POST /identity/v3/users => generated 295 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:01.418801 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e0c52-54a6-4e80-a5f4-a30e4d3cf339 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:01.485599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f9d8d-d584-4f27-8f5c-4ce258a81ef1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:01.509458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e0c52-54a6-4e80-a5f4-a30e4d3cf339 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:01.524306 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470346bf-fadf-4d3a-ad7c-58e556a3825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:01.534005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470346bf-fadf-4d3a-ad7c-58e556a3825b admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:01.538231 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470346bf-fadf-4d3a-ad7c-58e556a3825b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:01.539047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470346bf-fadf-4d3a-ad7c-58e556a3825b admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:01.543127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acddcd-b7c3-4b2f-9d5a-0b34ca5da54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:01.543921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470346bf-fadf-4d3a-ad7c-58e556a3825b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:01.547627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acddcd-b7c3-4b2f-9d5a-0b34ca5da54f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:01.565579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acddcd-b7c3-4b2f-9d5a-0b34ca5da54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:01.566574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470346bf-fadf-4d3a-ad7c-58e556a3825b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:01.569171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acddcd-b7c3-4b2f-9d5a-0b34ca5da54f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:01.571796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acddcd-b7c3-4b2f-9d5a-0b34ca5da54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:01.580686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acddcd-b7c3-4b2f-9d5a-0b34ca5da54f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:01.663106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 847/1708] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:01.670320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470346bf-fadf-4d3a-ad7c-58e556a3825b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:01.676713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 862/1709] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:01.692619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acddcd-b7c3-4b2f-9d5a-0b34ca5da54f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:01.751128 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470346bf-fadf-4d3a-ad7c-58e556a3825b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:01.761718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acddcd-b7c3-4b2f-9d5a-0b34ca5da54f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:01.787924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f35aa7-22bc-4650-b92e-07330c1e396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:01.792324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f35aa7-22bc-4650-b92e-07330c1e396c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:01.795816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f35aa7-22bc-4650-b92e-07330c1e396c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:01.795816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f35aa7-22bc-4650-b92e-07330c1e396c admin admin] PATH_INFO: `/v3/projects/09f02f868d4d45899160cf3bfa347ae9/users/6a7e20ef970a4f1abed81a3cfb9e3c31/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:01.816292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa366f-19f6-4c29-a1b0-d016a0406058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:01.819117 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa366f-19f6-4c29-a1b0-d016a0406058 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:01.819462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa366f-19f6-4c29-a1b0-d016a0406058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:01.820441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa366f-19f6-4c29-a1b0-d016a0406058 admin admin] PATH_INFO: `/v3/projects/c64cefc77349481d86dc458beb3651a0/users/ed717715fe1540d7a77a0759a4a3915a/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:01.900917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f35aa7-22bc-4650-b92e-07330c1e396c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f02f868d4d45899160cf3bfa347ae9, user_id=6a7e20ef970a4f1abed81a3cfb9e3c31, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:01.909319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa366f-19f6-4c29-a1b0-d016a0406058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64cefc77349481d86dc458beb3651a0, user_id=ed717715fe1540d7a77a0759a4a3915a, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:01.913453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f35aa7-22bc-4650-b92e-07330c1e396c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:01.916221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa366f-19f6-4c29-a1b0-d016a0406058 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:01.962135 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 848/1710] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:01 2022] PUT /identity/v3/projects/09f02f868d4d45899160cf3bfa347ae9/users/6a7e20ef970a4f1abed81a3cfb9e3c31/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:01.966739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f35aa7-22bc-4650-b92e-07330c1e396c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:01.968586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 863/1711] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:01 2022] PUT /identity/v3/projects/c64cefc77349481d86dc458beb3651a0/users/ed717715fe1540d7a77a0759a4a3915a/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:01.978529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa366f-19f6-4c29-a1b0-d016a0406058 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:02.251799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa366f-19f6-4c29-a1b0-d016a0406058 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:02.255357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f35aa7-22bc-4650-b92e-07330c1e396c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:02.267268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84550a11-7fb5-48e3-966e-02dc2cef623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:02.268766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550a11-7fb5-48e3-966e-02dc2cef623d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:02.268766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550a11-7fb5-48e3-966e-02dc2cef623d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:02.268766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550a11-7fb5-48e3-966e-02dc2cef623d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:02.269311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84550a11-7fb5-48e3-966e-02dc2cef623d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:02.270939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84550a11-7fb5-48e3-966e-02dc2cef623d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:02.280222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a34ac4-31af-4499-ad61-df19e5513c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:02.280870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34ac4-31af-4499-ad61-df19e5513c6b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:02.281215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34ac4-31af-4499-ad61-df19e5513c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:02.281492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34ac4-31af-4499-ad61-df19e5513c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:02.285259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a34ac4-31af-4499-ad61-df19e5513c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:02.287011 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a34ac4-31af-4499-ad61-df19e5513c6b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:02.299434 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 849/1712] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:02.304638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84550a11-7fb5-48e3-966e-02dc2cef623d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:02.324387 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84550a11-7fb5-48e3-966e-02dc2cef623d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:02.324596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 864/1713] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:02.330266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a34ac4-31af-4499-ad61-df19e5513c6b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:02.348173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaac2d7-b13a-4597-962f-09d151e5fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:02.349895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac2d7-b13a-4597-962f-09d151e5fe35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:02.350400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac2d7-b13a-4597-962f-09d151e5fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:02.350935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac2d7-b13a-4597-962f-09d151e5fe35 admin admin] PATH_INFO: `/v3/projects/09f02f868d4d45899160cf3bfa347ae9/users/6a7e20ef970a4f1abed81a3cfb9e3c31/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:02.357759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaac2d7-b13a-4597-962f-09d151e5fe35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f02f868d4d45899160cf3bfa347ae9, user_id=6a7e20ef970a4f1abed81a3cfb9e3c31, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:02.364625 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaac2d7-b13a-4597-962f-09d151e5fe35 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:02.372378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a34ac4-31af-4499-ad61-df19e5513c6b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:02.394578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9e812-44d9-4b50-b120-8d845843f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:02.395548 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e812-44d9-4b50-b120-8d845843f24d admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:02.395775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e812-44d9-4b50-b120-8d845843f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:02.396049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e812-44d9-4b50-b120-8d845843f24d admin admin] PATH_INFO: `/v3/projects/c64cefc77349481d86dc458beb3651a0/users/ed717715fe1540d7a77a0759a4a3915a/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:02.405927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 850/1714] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:02 2022] PUT /identity/v3/projects/09f02f868d4d45899160cf3bfa347ae9/users/6a7e20ef970a4f1abed81a3cfb9e3c31/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:02.417021 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9e812-44d9-4b50-b120-8d845843f24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64cefc77349481d86dc458beb3651a0, user_id=ed717715fe1540d7a77a0759a4a3915a, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:02.418076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ca02-bea0-48e5-9bfc-abd047d8fd22 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:02.418611 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ca02-bea0-48e5-9bfc-abd047d8fd22 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:02.419123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ca02-bea0-48e5-9bfc-abd047d8fd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:02.432468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9e812-44d9-4b50-b120-8d845843f24d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:02.475198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 865/1715] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:02 2022] PUT /identity/v3/projects/c64cefc77349481d86dc458beb3651a0/users/ed717715fe1540d7a77a0759a4a3915a/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:02.491780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06294a13-c35b-4d17-9b85-c2c791913b96 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:02.492134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06294a13-c35b-4d17-9b85-c2c791913b96 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:02.494760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ef37ca02-bea0-48e5-9bfc-abd047d8fd22 None None] MFA Rules not processed for user `6a7e20ef970a4f1abed81a3cfb9e3c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:02.496573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06294a13-c35b-4d17-9b85-c2c791913b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:02.501567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ef37ca02-bea0-48e5-9bfc-abd047d8fd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:02.602918 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-06294a13-c35b-4d17-9b85-c2c791913b96 None None] MFA Rules not processed for user `ed717715fe1540d7a77a0759a4a3915a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:02.604105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-06294a13-c35b-4d17-9b85-c2c791913b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:02.631319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:02.701503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 851/1716] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:02.709130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37ca02-bea0-48e5-9bfc-abd047d8fd22 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:02.711650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ef37ca02-bea0-48e5-9bfc-abd047d8fd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:02.779457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:02.838686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 866/1717] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:02.850310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06294a13-c35b-4d17-9b85-c2c791913b96 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:02.852658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-06294a13-c35b-4d17-9b85-c2c791913b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:02.892262 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37ca02-bea0-48e5-9bfc-abd047d8fd22 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:02.906124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a27f8d-cda5-4eff-9ae6-cd5901a60b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:02.906827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a27f8d-cda5-4eff-9ae6-cd5901a60b03 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:02.907107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a27f8d-cda5-4eff-9ae6-cd5901a60b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:02.907386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a27f8d-cda5-4eff-9ae6-cd5901a60b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:03.002434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06294a13-c35b-4d17-9b85-c2c791913b96 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:03.012636 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540d3ca-a8c3-4d30-900f-2ce9df8679aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:03.013578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540d3ca-a8c3-4d30-900f-2ce9df8679aa service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:03.016686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540d3ca-a8c3-4d30-900f-2ce9df8679aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:03.017991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540d3ca-a8c3-4d30-900f-2ce9df8679aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:03.043577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540d3ca-a8c3-4d30-900f-2ce9df8679aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:03.045259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540d3ca-a8c3-4d30-900f-2ce9df8679aa service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:03.075331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 867/1718] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:03.076434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540d3ca-a8c3-4d30-900f-2ce9df8679aa service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:03.078106 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7540d3ca-a8c3-4d30-900f-2ce9df8679aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:03.089145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a27f8d-cda5-4eff-9ae6-cd5901a60b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:03.093866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a27f8d-cda5-4eff-9ae6-cd5901a60b03 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:03.125655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 852/1719] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:03.128360 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11c45-0da0-498a-b14c-ce8b4ddae921 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:03.132015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11c45-0da0-498a-b14c-ce8b4ddae921 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:03.132015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11c45-0da0-498a-b14c-ce8b4ddae921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:03.193002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-74a11c45-0da0-498a-b14c-ce8b4ddae921 None None] MFA Rules not processed for user `54246fdf77f9409daa0d3ba70a30e8ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:03.194294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-74a11c45-0da0-498a-b14c-ce8b4ddae921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:03.327815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540d3ca-a8c3-4d30-900f-2ce9df8679aa service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:03.329453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 853/1720] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:03.338906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:03.342113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dfef4-cda0-46ff-9565-8915548ce643 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:03.342113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dfef4-cda0-46ff-9565-8915548ce643 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:03.342113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dfef4-cda0-46ff-9565-8915548ce643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:03.344047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:03.344446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:03.344619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] PATH_INFO: `/v3/projects/f9129daf25b24f198fe7d085b3de5185` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:03.346443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9129daf25b24f198fe7d085b3de5185)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:03.367078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:03.381848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-171dfef4-cda0-46ff-9565-8915548ce643 None None] MFA Rules not processed for user `54246fdf77f9409daa0d3ba70a30e8ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:03.386736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-171dfef4-cda0-46ff-9565-8915548ce643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:03.404319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 854/1721] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:03.426871 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dfef4-cda0-46ff-9565-8915548ce643 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:03.429980 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-171dfef4-cda0-46ff-9565-8915548ce643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:03.574604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9129daf25b24f198fe7d085b3de5185', 'request_id': 'req-9bf8055c-1c7b-4509-8464-357879df8060'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:03.602116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:03.605250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9129daf25b24f198fe7d085b3de5185', 'request_id': 'req-9bf8055c-1c7b-4509-8464-357879df8060'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:03.646530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9129daf25b24f198fe7d085b3de5185', 'request_id': 'req-9bf8055c-1c7b-4509-8464-357879df8060'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:03.741583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] The token cache is being invalidate because project f9129daf25b24f198fe7d085b3de5185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:03.745154 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:03.749158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9bf8055c-1c7b-4509-8464-357879df8060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:03.759740 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 868/1722] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:03 2022] DELETE /identity/v3/projects/f9129daf25b24f198fe7d085b3de5185 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:03.769406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf14b2-e709-4187-bbdd-b15377e00f7d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:03.771965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf14b2-e709-4187-bbdd-b15377e00f7d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:03.773716 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf14b2-e709-4187-bbdd-b15377e00f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:03.928324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dfef4-cda0-46ff-9565-8915548ce643 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:03.954217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-67cf14b2-e709-4187-bbdd-b15377e00f7d None None] MFA Rules not processed for user `eca463f83a0d4677b1c10d388ab60419`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:03.956935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-67cf14b2-e709-4187-bbdd-b15377e00f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:04.024282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:04.200112 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae75a53-9746-40b7-b8e8-71e747cda51f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:04.201955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75a53-9746-40b7-b8e8-71e747cda51f service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:04.202468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75a53-9746-40b7-b8e8-71e747cda51f service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:04.204219 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75a53-9746-40b7-b8e8-71e747cda51f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:04.211785 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fae75a53-9746-40b7-b8e8-71e747cda51f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:04.298123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 869/1723] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:04.298123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b5a17-1cdb-4507-bc16-115e96835231 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:04.298123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b5a17-1cdb-4507-bc16-115e96835231 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:04.298123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b5a17-1cdb-4507-bc16-115e96835231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:04.378405 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-341b5a17-1cdb-4507-bc16-115e96835231 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:04.379694 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-341b5a17-1cdb-4507-bc16-115e96835231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:04.420542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae75a53-9746-40b7-b8e8-71e747cda51f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:04.422548 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae75a53-9746-40b7-b8e8-71e747cda51f service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:04.437920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 855/1724] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 1012 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:04.438799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae75a53-9746-40b7-b8e8-71e747cda51f service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:04.441896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fae75a53-9746-40b7-b8e8-71e747cda51f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:04.495201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae75a53-9746-40b7-b8e8-71e747cda51f service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:04.504425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5de51-230f-4b6e-b6aa-65d7dfd84468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:04.505974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5de51-230f-4b6e-b6aa-65d7dfd84468 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:04.507293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5de51-230f-4b6e-b6aa-65d7dfd84468 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:04.508722 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5de51-230f-4b6e-b6aa-65d7dfd84468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:04.525856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5de51-230f-4b6e-b6aa-65d7dfd84468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:04.533818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5de51-230f-4b6e-b6aa-65d7dfd84468 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:04.552816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 856/1725] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:04.647733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 870/1726] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:04.674336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92636cc-e651-438f-bc67-21ad679b4194 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:04.693981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92636cc-e651-438f-bc67-21ad679b4194 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:04.706496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92636cc-e651-438f-bc67-21ad679b4194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:04.878154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c92636cc-e651-438f-bc67-21ad679b4194 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:04.901583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c92636cc-e651-438f-bc67-21ad679b4194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:04.981350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 857/1727] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:04.982722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b5a17-1cdb-4507-bc16-115e96835231 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:04.999945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b5a17-1cdb-4507-bc16-115e96835231 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:05.021952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5904a9-3e05-4840-8221-0abda1a70309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:05.022649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5904a9-3e05-4840-8221-0abda1a70309 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:05.023140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5904a9-3e05-4840-8221-0abda1a70309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:05.023677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5904a9-3e05-4840-8221-0abda1a70309 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:05.024623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5904a9-3e05-4840-8221-0abda1a70309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:05.025094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5904a9-3e05-4840-8221-0abda1a70309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:05.026960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5904a9-3e05-4840-8221-0abda1a70309 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:05.036613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92636cc-e651-438f-bc67-21ad679b4194 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:05.038497 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c92636cc-e651-438f-bc67-21ad679b4194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:05.068462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 871/1728] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:05.069372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5904a9-3e05-4840-8221-0abda1a70309 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:05.091890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5904a9-3e05-4840-8221-0abda1a70309 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:05.105283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:05.115151 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c5145-3e6a-44ba-af68-14e08fbd5901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:05.116197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5145-3e6a-44ba-af68-14e08fbd5901 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:05.116517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5145-3e6a-44ba-af68-14e08fbd5901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:05.116835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5145-3e6a-44ba-af68-14e08fbd5901 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:05.117705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c5145-3e6a-44ba-af68-14e08fbd5901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:05.119627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c5145-3e6a-44ba-af68-14e08fbd5901 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:05.155505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92636cc-e651-438f-bc67-21ad679b4194 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:05.168803 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d703c1d-22d7-4410-a011-7953f8ec3c33 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed717715fe1540d7a77a0759a4a3915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64cefc77349481d86dc458beb3651a0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:05.170242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d703c1d-22d7-4410-a011-7953f8ec3c33 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:05.172728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d703c1d-22d7-4410-a011-7953f8ec3c33 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:05.173930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d703c1d-22d7-4410-a011-7953f8ec3c33 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:05.174607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 872/1729] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:05 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:05.175519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c5145-3e6a-44ba-af68-14e08fbd5901 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:05.176220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d703c1d-22d7-4410-a011-7953f8ec3c33 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:05.177327 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d703c1d-22d7-4410-a011-7953f8ec3c33 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:05.179780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d703c1d-22d7-4410-a011-7953f8ec3c33 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:05.220663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 858/1730] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:05.222388 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d703c1d-22d7-4410-a011-7953f8ec3c33 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:05.246795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d703c1d-22d7-4410-a011-7953f8ec3c33 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:05.380115 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c5145-3e6a-44ba-af68-14e08fbd5901 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:05.386345 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b1828-9d92-4d81-ae47-321d2a8bdeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:05.387350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1828-9d92-4d81-ae47-321d2a8bdeff admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:05.387862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1828-9d92-4d81-ae47-321d2a8bdeff admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:05.389013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1828-9d92-4d81-ae47-321d2a8bdeff admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:05.389806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b1828-9d92-4d81-ae47-321d2a8bdeff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:05.409972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b1828-9d92-4d81-ae47-321d2a8bdeff admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:05.461631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 873/1731] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:05 2022] POST /identity/v3/users => generated 287 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:05.464494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b1828-9d92-4d81-ae47-321d2a8bdeff admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:05.496732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b1828-9d92-4d81-ae47-321d2a8bdeff admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:05.502026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea8b63-b364-45ba-9084-64d0c2e0b9ef tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed717715fe1540d7a77a0759a4a3915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64cefc77349481d86dc458beb3651a0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:05.502727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea8b63-b364-45ba-9084-64d0c2e0b9ef tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:05.503050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea8b63-b364-45ba-9084-64d0c2e0b9ef tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:05.503238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9809b82-ea87-4471-bd24-60deda9b6b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:05.503348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea8b63-b364-45ba-9084-64d0c2e0b9ef tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:05.503993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea8b63-b364-45ba-9084-64d0c2e0b9ef tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:05.504199 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809b82-ea87-4471-bd24-60deda9b6b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:05.504492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809b82-ea87-4471-bd24-60deda9b6b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:05.505050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809b82-ea87-4471-bd24-60deda9b6b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:05.505875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9809b82-ea87-4471-bd24-60deda9b6b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:05.506097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea8b63-b364-45ba-9084-64d0c2e0b9ef tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:05.508045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9809b82-ea87-4471-bd24-60deda9b6b39 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:05.515873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:05.529143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 874/1732] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:05.533109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9809b82-ea87-4471-bd24-60deda9b6b39 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:05.546391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9809b82-ea87-4471-bd24-60deda9b6b39 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:05.551489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a93ff-5e4f-4a84-bfd6-4b4cbe3b799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:05.553309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a93ff-5e4f-4a84-bfd6-4b4cbe3b799a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:05.553309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a93ff-5e4f-4a84-bfd6-4b4cbe3b799a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:05.553309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a93ff-5e4f-4a84-bfd6-4b4cbe3b799a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:05.553947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a93ff-5e4f-4a84-bfd6-4b4cbe3b799a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:05.556009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a93ff-5e4f-4a84-bfd6-4b4cbe3b799a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:05.580993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 875/1733] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:31:05.586543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a93ff-5e4f-4a84-bfd6-4b4cbe3b799a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:05.591614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 859/1734] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:05 2022] POST /identity/v3/projects => generated 354 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:05.596285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea8b63-b364-45ba-9084-64d0c2e0b9ef tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:05.601453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a93ff-5e4f-4a84-bfd6-4b4cbe3b799a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:05.692694 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166ff6b-cdfc-4523-9d19-0ae5ebc683b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:05.694611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ff6b-cdfc-4523-9d19-0ae5ebc683b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:05.696997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ff6b-cdfc-4523-9d19-0ae5ebc683b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:05.697490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ff6b-cdfc-4523-9d19-0ae5ebc683b3 admin admin] PATH_INFO: `/v3/projects/e511d14a407e45e4a5fabae3b94f7240/users/3e81c19861ea4122b20240ae04e8fa19/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:05.725950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166ff6b-cdfc-4523-9d19-0ae5ebc683b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e511d14a407e45e4a5fabae3b94f7240, user_id=3e81c19861ea4122b20240ae04e8fa19, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:05.728751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166ff6b-cdfc-4523-9d19-0ae5ebc683b3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:05.785094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 876/1735] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:05 2022] PUT /identity/v3/projects/e511d14a407e45e4a5fabae3b94f7240/users/3e81c19861ea4122b20240ae04e8fa19/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:05.787875 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea8b63-b364-45ba-9084-64d0c2e0b9ef tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:05.791722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63eba2-e620-4e4b-9109-8b15195df839 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:05.792458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63eba2-e620-4e4b-9109-8b15195df839 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:05.792950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63eba2-e620-4e4b-9109-8b15195df839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:05.860817 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bb63eba2-e620-4e4b-9109-8b15195df839 None None] MFA Rules not processed for user `3e81c19861ea4122b20240ae04e8fa19`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:05.864845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bb63eba2-e620-4e4b-9109-8b15195df839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:05.982825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b256f1-d7be-4f30-bae6-c8623f793a89 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed717715fe1540d7a77a0759a4a3915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64cefc77349481d86dc458beb3651a0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:05.983747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b256f1-d7be-4f30-bae6-c8623f793a89 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:05.984107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b256f1-d7be-4f30-bae6-c8623f793a89 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:05.984322 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b256f1-d7be-4f30-bae6-c8623f793a89 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:05.985178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b256f1-d7be-4f30-bae6-c8623f793a89 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:05.985496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b256f1-d7be-4f30-bae6-c8623f793a89 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:05.987158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b256f1-d7be-4f30-bae6-c8623f793a89 tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:06.008779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:06.029655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 877/1736] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:06.030203 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 860/1737] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:31:06.032254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9fcb0-c5fe-42ca-9da7-7c4fadc0104e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:06.032544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f9cb-a4a1-4b04-a29c-6c4d82ad1723 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:06.035960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f9cb-a4a1-4b04-a29c-6c4d82ad1723 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:06.036290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f9cb-a4a1-4b04-a29c-6c4d82ad1723 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:06.048243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9fcb0-c5fe-42ca-9da7-7c4fadc0104e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:06.048892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9fcb0-c5fe-42ca-9da7-7c4fadc0104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:06.049428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 861/1738] 10.222.0.30 () {54 vars in 912 bytes} [Wed Jul 6 20:31:06 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:31:06.050430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224f9cb-a4a1-4b04-a29c-6c4d82ad1723 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:06.126623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-21e9fcb0-c5fe-42ca-9da7-7c4fadc0104e None None] MFA Rules not processed for user `3c50cd073cfa45bc9dc52dc65bf7e945`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:06.128981 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-21e9fcb0-c5fe-42ca-9da7-7c4fadc0104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:06.279065 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 878/1739] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:06.280451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1c781-e433-452f-8a3b-621c842fdf26 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:06.281321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224f9cb-a4a1-4b04-a29c-6c4d82ad1723 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:06.282640 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1c781-e433-452f-8a3b-621c842fdf26 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:06.283049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1c781-e433-452f-8a3b-621c842fdf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:06.294820 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:06.297306 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fc333-7534-49cc-a1bc-d1e6b7ec54f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:06.300193 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fc333-7534-49cc-a1bc-d1e6b7ec54f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:06.301241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fc333-7534-49cc-a1bc-d1e6b7ec54f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:06.303132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fc333-7534-49cc-a1bc-d1e6b7ec54f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:06.303900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fc333-7534-49cc-a1bc-d1e6b7ec54f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:06.305935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fc333-7534-49cc-a1bc-d1e6b7ec54f5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:06.359096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7ec1c781-e433-452f-8a3b-621c842fdf26 None None] MFA Rules not processed for user `1c5ad3094ee04495a6ab82c92d458aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:06.360348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7ec1c781-e433-452f-8a3b-621c842fdf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:06.439514 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 862/1740] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:06 2022] POST /identity/v3/projects => generated 369 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:06.440303 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fc333-7534-49cc-a1bc-d1e6b7ec54f5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:06.458315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 879/1741] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:06.459345 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae7165-538b-4ecf-a98a-5cdb6fd85f95 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:06.460479 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae7165-538b-4ecf-a98a-5cdb6fd85f95 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:06.461905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae7165-538b-4ecf-a98a-5cdb6fd85f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:06.545303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-53ae7165-538b-4ecf-a98a-5cdb6fd85f95 None None] MFA Rules not processed for user `0a1c4a7e4fdc4a829b8acf762bf576c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:06.546631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-53ae7165-538b-4ecf-a98a-5cdb6fd85f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:06.697484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fc333-7534-49cc-a1bc-d1e6b7ec54f5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:06.708293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed717715fe1540d7a77a0759a4a3915a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64cefc77349481d86dc458beb3651a0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:06.709366 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:06.710471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:06.711264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] PATH_INFO: `/v3/projects/fbbc6e4c38df43b194b1f3b61646983c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:06.714904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fbbc6e4c38df43b194b1f3b61646983c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:06.721830 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:06.784911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 880/1742] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:06.796770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae7165-538b-4ecf-a98a-5cdb6fd85f95 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:06.859127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbc6e4c38df43b194b1f3b61646983c', 'request_id': 'req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:06.871038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbc6e4c38df43b194b1f3b61646983c', 'request_id': 'req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:06.887801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbc6e4c38df43b194b1f3b61646983c', 'request_id': 'req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:06.913316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] The token cache is being invalidate because project fbbc6e4c38df43b194b1f3b61646983c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:06.913776 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:06.915351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:06.918826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 863/1743] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:06 2022] DELETE /identity/v3/projects/fbbc6e4c38df43b194b1f3b61646983c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:06.946548 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:06.953680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:06.991702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:07.002937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae7165-538b-4ecf-a98a-5cdb6fd85f95 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:07.137376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1f05-f97f-4fc3-83ed-46f78ff695bc tempest-VolumeQuotaClassesTest-19909912 tempest-VolumeQuotaClassesTest-19909912-project-admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:07.142042 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803eefd-3208-4501-8dd6-12be85ce80d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:07.146691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:07.149526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803eefd-3208-4501-8dd6-12be85ce80d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.149950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803eefd-3208-4501-8dd6-12be85ce80d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.150293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803eefd-3208-4501-8dd6-12be85ce80d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.152929 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a803eefd-3208-4501-8dd6-12be85ce80d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:07.180350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803eefd-3208-4501-8dd6-12be85ce80d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:07.189948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803eefd-3208-4501-8dd6-12be85ce80d8 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:07.207570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 864/1744] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:07.211268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b08f9-222a-401f-a084-34a5ef5b73d3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.211593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b08f9-222a-401f-a084-34a5ef5b73d3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.211898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b08f9-222a-401f-a084-34a5ef5b73d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.230637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dba41-f111-44df-a738-ad21405de48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:07.234925 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dba41-f111-44df-a738-ad21405de48a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.235823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dba41-f111-44df-a738-ad21405de48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.237459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dba41-f111-44df-a738-ad21405de48a admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.238234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dba41-f111-44df-a738-ad21405de48a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:07.240228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dba41-f111-44df-a738-ad21405de48a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:07.288879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b56b08f9-222a-401f-a084-34a5ef5b73d3 None None] MFA Rules not processed for user `0a1c4a7e4fdc4a829b8acf762bf576c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:07.290528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b56b08f9-222a-401f-a084-34a5ef5b73d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:07.307750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 881/1745] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:06 2022] POST /identity/v3/users => generated 291 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:07.309529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac181-321d-44b4-a88a-841d442c5d89 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.309822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac181-321d-44b4-a88a-841d442c5d89 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.310102 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac181-321d-44b4-a88a-841d442c5d89 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.318280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 882/1746] 10.222.0.30 () {54 vars in 912 bytes} [Wed Jul 6 20:31:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:31:07.320416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ac181-321d-44b4-a88a-841d442c5d89 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:07.324833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-db9ac181-321d-44b4-a88a-841d442c5d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:07.357735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ac181-321d-44b4-a88a-841d442c5d89 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:07.367633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddf294-9f66-477e-bc40-7fc2873e2630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:07.371866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddf294-9f66-477e-bc40-7fc2873e2630 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.372176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddf294-9f66-477e-bc40-7fc2873e2630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.372461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddf294-9f66-477e-bc40-7fc2873e2630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.373434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddf294-9f66-477e-bc40-7fc2873e2630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:07.376883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddf294-9f66-477e-bc40-7fc2873e2630 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:07.405231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 883/1747] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:07.406930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5e2ee-3b51-4768-a167-aa3019bd6ab8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.408417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5e2ee-3b51-4768-a167-aa3019bd6ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.409658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5e2ee-3b51-4768-a167-aa3019bd6ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.416714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 865/1748] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:07.417792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b08f9-222a-401f-a084-34a5ef5b73d3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:07.447749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b08f9-222a-401f-a084-34a5ef5b73d3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:07.455414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-86b5e2ee-3b51-4768-a167-aa3019bd6ab8 None None] MFA Rules not processed for user `1c5ad3094ee04495a6ab82c92d458aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:07.457152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-86b5e2ee-3b51-4768-a167-aa3019bd6ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:07.463103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0776cb-9832-481b-80bb-3eda3ed09d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:07.464456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0776cb-9832-481b-80bb-3eda3ed09d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.465068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0776cb-9832-481b-80bb-3eda3ed09d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.465659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0776cb-9832-481b-80bb-3eda3ed09d3e admin admin] PATH_INFO: `/v3/projects/3c4b2d271a38448f97fa1c6bd4088fc5/users/fb2153eca1dd4bf89fb83ca1a857186d/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.467859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 884/1749] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:07.478623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5e2ee-3b51-4768-a167-aa3019bd6ab8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:07.480329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-86b5e2ee-3b51-4768-a167-aa3019bd6ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:07.501034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0776cb-9832-481b-80bb-3eda3ed09d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4b2d271a38448f97fa1c6bd4088fc5, user_id=fb2153eca1dd4bf89fb83ca1a857186d, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:07.506119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5e2ee-3b51-4768-a167-aa3019bd6ab8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:07.507274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0776cb-9832-481b-80bb-3eda3ed09d3e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:07.514760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:07.516142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.516668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.517051 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] PATH_INFO: `/v3/users/400a0870a75e43ec93596153f6b0604f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.518436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=400a0870a75e43ec93596153f6b0604f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:07.520666 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:07.540878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 866/1750] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:07 2022] PUT /identity/v3/projects/3c4b2d271a38448f97fa1c6bd4088fc5/users/fb2153eca1dd4bf89fb83ca1a857186d/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:07.542013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0776cb-9832-481b-80bb-3eda3ed09d3e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:07.601199 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400a0870a75e43ec93596153f6b0604f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:07.617214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400a0870a75e43ec93596153f6b0604f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:07.618592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400a0870a75e43ec93596153f6b0604f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:07.635311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400a0870a75e43ec93596153f6b0604f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:07.657331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400a0870a75e43ec93596153f6b0604f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:07.670774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0776cb-9832-481b-80bb-3eda3ed09d3e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:07.674140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 885/1751] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:07 2022] DELETE /identity/v3/users/400a0870a75e43ec93596153f6b0604f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:07.677858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:07.681050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:07.787945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8b196-2b67-41fb-b49a-73d9552422eb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:07.796242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915998de-e7b7-42c7-8f90-5469bebadd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:07.796923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915998de-e7b7-42c7-8f90-5469bebadd79 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.797229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915998de-e7b7-42c7-8f90-5469bebadd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.797503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915998de-e7b7-42c7-8f90-5469bebadd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.800628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-915998de-e7b7-42c7-8f90-5469bebadd79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:07.811472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba8542-9ec3-4946-9fe2-b73b5788396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:07.814948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:07.817941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba8542-9ec3-4946-9fe2-b73b5788396a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.817941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba8542-9ec3-4946-9fe2-b73b5788396a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.818155 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba8542-9ec3-4946-9fe2-b73b5788396a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.819369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba8542-9ec3-4946-9fe2-b73b5788396a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:07.821550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba8542-9ec3-4946-9fe2-b73b5788396a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:07.822495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915998de-e7b7-42c7-8f90-5469bebadd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:07.824016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915998de-e7b7-42c7-8f90-5469bebadd79 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:07.838103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 886/1752] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:07.839629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd853b18-0c43-44ea-aa74-73e031eefe37 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.839918 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd853b18-0c43-44ea-aa74-73e031eefe37 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.840325 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd853b18-0c43-44ea-aa74-73e031eefe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.868089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fd853b18-0c43-44ea-aa74-73e031eefe37 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:07.868089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fd853b18-0c43-44ea-aa74-73e031eefe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:07.868989 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 867/1753] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:07.868989 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915998de-e7b7-42c7-8f90-5469bebadd79 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:07.894452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 887/1754] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:07.915579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915998de-e7b7-42c7-8f90-5469bebadd79 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:07.915778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd853b18-0c43-44ea-aa74-73e031eefe37 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:07.918235 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fd853b18-0c43-44ea-aa74-73e031eefe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:07.937235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5dadc-135c-49b5-a1d3-b6351ff8647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:07.939688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5dadc-135c-49b5-a1d3-b6351ff8647b admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.940244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5dadc-135c-49b5-a1d3-b6351ff8647b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.940530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5dadc-135c-49b5-a1d3-b6351ff8647b admin admin] PATH_INFO: `/v3/projects/3c4b2d271a38448f97fa1c6bd4088fc5/users/fb2153eca1dd4bf89fb83ca1a857186d/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.947337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5dadc-135c-49b5-a1d3-b6351ff8647b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4b2d271a38448f97fa1c6bd4088fc5, user_id=fb2153eca1dd4bf89fb83ca1a857186d, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:07.949364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd853b18-0c43-44ea-aa74-73e031eefe37 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:07.956485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5dadc-135c-49b5-a1d3-b6351ff8647b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:07.968877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18dc49-9cb5-4578-be2a-9f96a8ec0c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:07.970091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18dc49-9cb5-4578-be2a-9f96a8ec0c29 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:07.970374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18dc49-9cb5-4578-be2a-9f96a8ec0c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:07.970649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18dc49-9cb5-4578-be2a-9f96a8ec0c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:07.993262 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 868/1755] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:07 2022] PUT /identity/v3/projects/3c4b2d271a38448f97fa1c6bd4088fc5/users/fb2153eca1dd4bf89fb83ca1a857186d/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:08.006496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e13fa-76fc-4266-b6a8-74edb816bd26 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:08.006782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e13fa-76fc-4266-b6a8-74edb816bd26 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:08.007060 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e13fa-76fc-4266-b6a8-74edb816bd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:08.016657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:08.022274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18dc49-9cb5-4578-be2a-9f96a8ec0c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:08.026852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18dc49-9cb5-4578-be2a-9f96a8ec0c29 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:08.053390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 888/1756] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:08.110856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-376e13fa-76fc-4266-b6a8-74edb816bd26 None None] MFA Rules not processed for user `fb2153eca1dd4bf89fb83ca1a857186d`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:08.116046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-376e13fa-76fc-4266-b6a8-74edb816bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:08.320373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18dc49-9cb5-4578-be2a-9f96a8ec0c29 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:08.322039 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-de18dc49-9cb5-4578-be2a-9f96a8ec0c29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:08.462534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 869/1757] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:08.475247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e13fa-76fc-4266-b6a8-74edb816bd26 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:08.478250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-376e13fa-76fc-4266-b6a8-74edb816bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:08.572413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18dc49-9cb5-4578-be2a-9f96a8ec0c29 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:08.731263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc3b41-7c53-41f4-93b1-30ea6e7f270f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:08.732415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3b41-7c53-41f4-93b1-30ea6e7f270f service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:08.732794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3b41-7c53-41f4-93b1-30ea6e7f270f service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:08.733241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3b41-7c53-41f4-93b1-30ea6e7f270f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:08.735418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-29dc3b41-7c53-41f4-93b1-30ea6e7f270f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:08.772772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e13fa-76fc-4266-b6a8-74edb816bd26 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:08.799071 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44849b3f-22f5-4c7f-8c33-eb5a3a1c8e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:08.799793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849b3f-22f5-4c7f-8c33-eb5a3a1c8e2f service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:08.800078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849b3f-22f5-4c7f-8c33-eb5a3a1c8e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:08.800362 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849b3f-22f5-4c7f-8c33-eb5a3a1c8e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:08.823059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc3b41-7c53-41f4-93b1-30ea6e7f270f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:08.825038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc3b41-7c53-41f4-93b1-30ea6e7f270f service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:08.836727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 889/1758] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:31:08.838301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dce4f-a0cd-4861-ab45-a77a2de0095c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:08.838510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dce4f-a0cd-4861-ab45-a77a2de0095c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:08.838796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dce4f-a0cd-4861-ab45-a77a2de0095c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:08.840504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 890/1759] 10.222.0.30 () {54 vars in 960 bytes} [Wed Jul 6 20:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:31:08.844655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44849b3f-22f5-4c7f-8c33-eb5a3a1c8e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:08.848265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9be5-f41a-40d3-9458-07e36a2a8c79 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:08.849436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9be5-f41a-40d3-9458-07e36a2a8c79 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:08.849436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9be5-f41a-40d3-9458-07e36a2a8c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:08.860026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44849b3f-22f5-4c7f-8c33-eb5a3a1c8e2f service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:08.901784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3b6d9be5-f41a-40d3-9458-07e36a2a8c79 None None] MFA Rules not processed for user `e0df36a267464042908bbd8eebc7c40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:08.905728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3b6d9be5-f41a-40d3-9458-07e36a2a8c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:08.922275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 870/1760] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:08.960383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:09.076398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44849b3f-22f5-4c7f-8c33-eb5a3a1c8e2f service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:09.085839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 891/1761] 10.222.0.30 () {58 vars in 1057 bytes} [Wed Jul 6 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:09.097212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44849b3f-22f5-4c7f-8c33-eb5a3a1c8e2f service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:09.097824 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d9be5-f41a-40d3-9458-07e36a2a8c79 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:09.104609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089febd-fc62-4e7f-becf-c53d8f3be583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:09.111433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089febd-fc62-4e7f-becf-c53d8f3be583 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:09.112452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089febd-fc62-4e7f-becf-c53d8f3be583 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:09.112883 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089febd-fc62-4e7f-becf-c53d8f3be583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:09.118444 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d9be5-f41a-40d3-9458-07e36a2a8c79 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:09.124324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b089febd-fc62-4e7f-becf-c53d8f3be583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:09.132820 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323db4d-eb53-486f-b6fd-8a2baf3a437a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df36a267464042908bbd8eebc7c40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:09.135802 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323db4d-eb53-486f-b6fd-8a2baf3a437a service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:09.136258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323db4d-eb53-486f-b6fd-8a2baf3a437a service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:09.136496 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323db4d-eb53-486f-b6fd-8a2baf3a437a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:09.141023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e323db4d-eb53-486f-b6fd-8a2baf3a437a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:09.171738 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323db4d-eb53-486f-b6fd-8a2baf3a437a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:09.179761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323db4d-eb53-486f-b6fd-8a2baf3a437a service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:09.203383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 892/1762] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:09.205671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474d5e1-0390-42c0-bc41-a2893a478fe9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:09.205965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474d5e1-0390-42c0-bc41-a2893a478fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:09.206246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474d5e1-0390-42c0-bc41-a2893a478fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:09.260932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2474d5e1-0390-42c0-bc41-a2893a478fe9 None None] MFA Rules not processed for user `eca463f83a0d4677b1c10d388ab60419`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:09.264053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2474d5e1-0390-42c0-bc41-a2893a478fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:09.305915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089febd-fc62-4e7f-becf-c53d8f3be583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:09.307398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089febd-fc62-4e7f-becf-c53d8f3be583 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:09.332247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 871/1763] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:09.401546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 893/1764] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:10.119296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089febd-fc62-4e7f-becf-c53d8f3be583 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:10.121478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b089febd-fc62-4e7f-becf-c53d8f3be583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:10.140727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:10.286203 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089febd-fc62-4e7f-becf-c53d8f3be583 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:10.298756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:10.299651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:10.300093 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:10.300505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] PATH_INFO: `/v3/projects/1fe4497fad8b463bb6e8bfcacf4aecfe` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:10.307326 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe4497fad8b463bb6e8bfcacf4aecfe)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:10.309491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:10.422450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe4497fad8b463bb6e8bfcacf4aecfe', 'request_id': 'req-39bf7606-7ba5-4890-b5de-fd1f5e96c229'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:10.437477 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe4497fad8b463bb6e8bfcacf4aecfe', 'request_id': 'req-39bf7606-7ba5-4890-b5de-fd1f5e96c229'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:10.447678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe4497fad8b463bb6e8bfcacf4aecfe', 'request_id': 'req-39bf7606-7ba5-4890-b5de-fd1f5e96c229'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:10.474196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] The token cache is being invalidate because project 1fe4497fad8b463bb6e8bfcacf4aecfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:10.474558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:10.475572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-39bf7606-7ba5-4890-b5de-fd1f5e96c229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:10.478513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 872/1765] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:10 2022] DELETE /identity/v3/projects/1fe4497fad8b463bb6e8bfcacf4aecfe => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:10.482550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474d5e1-0390-42c0-bc41-a2893a478fe9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:10.503623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474d5e1-0390-42c0-bc41-a2893a478fe9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:10.638326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:10.639308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:10.639528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:10.639803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] PATH_INFO: `/v3/users/ed717715fe1540d7a77a0759a4a3915a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:10.642096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed717715fe1540d7a77a0759a4a3915a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:10.644088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:10.811062 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed717715fe1540d7a77a0759a4a3915a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:10.859211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:10.869696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed717715fe1540d7a77a0759a4a3915a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:10.870469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed717715fe1540d7a77a0759a4a3915a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:10.886910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed717715fe1540d7a77a0759a4a3915a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:10.908723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed717715fe1540d7a77a0759a4a3915a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:10.931423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 894/1766] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:10 2022] DELETE /identity/v3/users/ed717715fe1540d7a77a0759a4a3915a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:11.426364 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f291cb-0b10-42e8-98d6-3a21bab1401a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:11.427014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f291cb-0b10-42e8-98d6-3a21bab1401a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:11.427734 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f291cb-0b10-42e8-98d6-3a21bab1401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:11.545832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-12f291cb-0b10-42e8-98d6-3a21bab1401a None None] MFA Rules not processed for user `0a1c4a7e4fdc4a829b8acf762bf576c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:11.549146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-12f291cb-0b10-42e8-98d6-3a21bab1401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:11.579111 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:11.582113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:11.744394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 873/1767] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:11.745711 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f291cb-0b10-42e8-98d6-3a21bab1401a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:11.749754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-12f291cb-0b10-42e8-98d6-3a21bab1401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:11.764020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d692c-ec8c-4837-9237-977f5c291fd3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:11.774372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb33c84-30bd-449d-b075-08b86018f2b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:11.775207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33c84-30bd-449d-b075-08b86018f2b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:11.778943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33c84-30bd-449d-b075-08b86018f2b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:11.779373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33c84-30bd-449d-b075-08b86018f2b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:11.783833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cdb33c84-30bd-449d-b075-08b86018f2b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:11.856826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:11.887643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f291cb-0b10-42e8-98d6-3a21bab1401a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:11.908266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:11.909750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:11.913136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:11.913775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] PATH_INFO: `/v3/projects/c64cefc77349481d86dc458beb3651a0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:11.915969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c64cefc77349481d86dc458beb3651a0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:11.921411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:11.953036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb33c84-30bd-449d-b075-08b86018f2b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:11.954556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb33c84-30bd-449d-b075-08b86018f2b8 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:12.027824 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 895/1768] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:12.076701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64cefc77349481d86dc458beb3651a0', 'request_id': 'req-b7724272-8991-4ed8-b8ed-e67bd98b4068'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:12.102996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64cefc77349481d86dc458beb3651a0', 'request_id': 'req-b7724272-8991-4ed8-b8ed-e67bd98b4068'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:12.119714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64cefc77349481d86dc458beb3651a0', 'request_id': 'req-b7724272-8991-4ed8-b8ed-e67bd98b4068'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:12.145852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] The token cache is being invalidate because project c64cefc77349481d86dc458beb3651a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:12.146306 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:12.148344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b7724272-8991-4ed8-b8ed-e67bd98b4068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:12.150937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 874/1769] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:11 2022] DELETE /identity/v3/projects/c64cefc77349481d86dc458beb3651a0 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:12.157707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59302c-048f-4195-a4f1-3eff32e5c079 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:12.158172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59302c-048f-4195-a4f1-3eff32e5c079 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:12.158585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59302c-048f-4195-a4f1-3eff32e5c079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:12.198582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6b59302c-048f-4195-a4f1-3eff32e5c079 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:12.200168 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6b59302c-048f-4195-a4f1-3eff32e5c079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:12.432191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 896/1770] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:12.438143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0d83d-ba7d-4113-af4a-f968b5d0e242 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:12.438661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0d83d-ba7d-4113-af4a-f968b5d0e242 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:12.438732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0d83d-ba7d-4113-af4a-f968b5d0e242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:12.499203 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d0a0d83d-ba7d-4113-af4a-f968b5d0e242 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:12.506547 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d0a0d83d-ba7d-4113-af4a-f968b5d0e242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:12.543504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 875/1771] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:12.547450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59302c-048f-4195-a4f1-3eff32e5c079 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:12.572007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59302c-048f-4195-a4f1-3eff32e5c079 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:12.599435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ddbed-a4ec-4fbf-91be-39dc106c678b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:12.601838 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ddbed-a4ec-4fbf-91be-39dc106c678b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:12.602735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ddbed-a4ec-4fbf-91be-39dc106c678b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:12.603023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ddbed-a4ec-4fbf-91be-39dc106c678b admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:12.607567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ddbed-a4ec-4fbf-91be-39dc106c678b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:12.608428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ddbed-a4ec-4fbf-91be-39dc106c678b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:12.616660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ddbed-a4ec-4fbf-91be-39dc106c678b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:12.692620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 897/1772] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:12.693868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0d83d-ba7d-4113-af4a-f968b5d0e242 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:12.709151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0d83d-ba7d-4113-af4a-f968b5d0e242 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:12.732850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154817-8ce5-4d1b-90cb-a0327b3bbb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:12.733575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154817-8ce5-4d1b-90cb-a0327b3bbb56 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:12.733856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154817-8ce5-4d1b-90cb-a0327b3bbb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:12.734121 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154817-8ce5-4d1b-90cb-a0327b3bbb56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:12.736501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09154817-8ce5-4d1b-90cb-a0327b3bbb56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:12.747603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09154817-8ce5-4d1b-90cb-a0327b3bbb56 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:12.895219 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 876/1773] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:12 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:12.897932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ddbed-a4ec-4fbf-91be-39dc106c678b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:12.921457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ddbed-a4ec-4fbf-91be-39dc106c678b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:13.040905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:13.356095 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e168593-ee90-4531-b862-44e72dd86514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:13.356804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e168593-ee90-4531-b862-44e72dd86514 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:13.357112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e168593-ee90-4531-b862-44e72dd86514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:13.357390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e168593-ee90-4531-b862-44e72dd86514 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:13.358100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e168593-ee90-4531-b862-44e72dd86514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:13.377723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e168593-ee90-4531-b862-44e72dd86514 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:13.452872 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 898/1774] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:12 2022] POST /identity/v3/users => generated 294 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:13.456736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154817-8ce5-4d1b-90cb-a0327b3bbb56 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:13.487509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154817-8ce5-4d1b-90cb-a0327b3bbb56 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:13.505690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a5da0-1d01-419b-9653-47ce8be1ca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:13.506716 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a5da0-1d01-419b-9653-47ce8be1ca4a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:13.507139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a5da0-1d01-419b-9653-47ce8be1ca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:13.507630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a5da0-1d01-419b-9653-47ce8be1ca4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:13.508533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a5da0-1d01-419b-9653-47ce8be1ca4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:13.513709 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a5da0-1d01-419b-9653-47ce8be1ca4a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:13.552336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e168593-ee90-4531-b862-44e72dd86514 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:13.554292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0e168593-ee90-4531-b862-44e72dd86514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:13.585270 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 877/1775] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:13.598519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e168593-ee90-4531-b862-44e72dd86514 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:13.602775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a5da0-1d01-419b-9653-47ce8be1ca4a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:13.633744 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:13.634694 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:13.634976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:13.635250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] PATH_INFO: `/v3/users/391e8942fac246ee86d4734288fe369b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:13.654338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=391e8942fac246ee86d4734288fe369b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:13.656350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:13.659782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a5da0-1d01-419b-9653-47ce8be1ca4a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:13.705352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d8b0-e2df-4830-8061-1f3d03fb5fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:13.706116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d8b0-e2df-4830-8061-1f3d03fb5fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:13.706399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d8b0-e2df-4830-8061-1f3d03fb5fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:13.706674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d8b0-e2df-4830-8061-1f3d03fb5fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:13.707424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83d8b0-e2df-4830-8061-1f3d03fb5fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:13.709091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83d8b0-e2df-4830-8061-1f3d03fb5fa4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:13.739900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 878/1776] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:13.742375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154acb2-12c0-4683-b867-46ed193af20e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:13.742678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154acb2-12c0-4683-b867-46ed193af20e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:13.742940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154acb2-12c0-4683-b867-46ed193af20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:13.797214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391e8942fac246ee86d4734288fe369b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:13.806612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a154acb2-12c0-4683-b867-46ed193af20e None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:13.807893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a154acb2-12c0-4683-b867-46ed193af20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:13.847919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391e8942fac246ee86d4734288fe369b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:13.852667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391e8942fac246ee86d4734288fe369b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:13.873872 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391e8942fac246ee86d4734288fe369b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:13.891714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391e8942fac246ee86d4734288fe369b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:13.916303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 899/1777] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:13 2022] DELETE /identity/v3/users/391e8942fac246ee86d4734288fe369b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:13.918074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:13.921786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:13.966915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 879/1778] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:31:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:13.968257 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c14e8-167b-445e-8923-1ba0917dd33c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:13.968544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c14e8-167b-445e-8923-1ba0917dd33c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:13.968816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c14e8-167b-445e-8923-1ba0917dd33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:14.007981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-418c14e8-167b-445e-8923-1ba0917dd33c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:14.009227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-418c14e8-167b-445e-8923-1ba0917dd33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:14.063528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d52ab-0481-42f5-96a2-ed3148e64300 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:14.066164 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:14.072216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a3f1b-b1ab-4048-bed3-a71f7f946089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:14.073178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a3f1b-b1ab-4048-bed3-a71f7f946089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:14.073461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a3f1b-b1ab-4048-bed3-a71f7f946089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:14.073927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a3f1b-b1ab-4048-bed3-a71f7f946089 admin admin] PATH_INFO: `/v3/projects/6a525c64d79f4366acde3fc00617fb92/users/b276ac033d0b431a866bcbfe3b811e67/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:14.107564 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a3f1b-b1ab-4048-bed3-a71f7f946089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a525c64d79f4366acde3fc00617fb92, user_id=b276ac033d0b431a866bcbfe3b811e67, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:14.112781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a3f1b-b1ab-4048-bed3-a71f7f946089 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:14.133022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 880/1779] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:14.140406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:14.150400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c14e8-167b-445e-8923-1ba0917dd33c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:14.153102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-418c14e8-167b-445e-8923-1ba0917dd33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:14.154339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 900/1780] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:13 2022] PUT /identity/v3/projects/6a525c64d79f4366acde3fc00617fb92/users/b276ac033d0b431a866bcbfe3b811e67/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:14.156163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea4aac-83fb-4a16-98e8-731eed93d405 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:14.156461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea4aac-83fb-4a16-98e8-731eed93d405 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:14.157001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea4aac-83fb-4a16-98e8-731eed93d405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:14.252400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f4ea4aac-83fb-4a16-98e8-731eed93d405 None None] MFA Rules not processed for user `b276ac033d0b431a866bcbfe3b811e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:14.255693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f4ea4aac-83fb-4a16-98e8-731eed93d405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:14.257862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c14e8-167b-445e-8923-1ba0917dd33c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:14.420858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a354457-47c0-4f89-83a4-9ec9de81d981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:14.424395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a354457-47c0-4f89-83a4-9ec9de81d981 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:14.424680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a354457-47c0-4f89-83a4-9ec9de81d981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:14.424990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a354457-47c0-4f89-83a4-9ec9de81d981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:14.465761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 901/1781] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:14.471620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea4aac-83fb-4a16-98e8-731eed93d405 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:14.481357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f4ea4aac-83fb-4a16-98e8-731eed93d405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:14.642247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea4aac-83fb-4a16-98e8-731eed93d405 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:14.651857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6cc00-5c50-49f6-b5f6-80077c99d7d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:14.654092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6cc00-5c50-49f6-b5f6-80077c99d7d6 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:14.654631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6cc00-5c50-49f6-b5f6-80077c99d7d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:14.655272 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6cc00-5c50-49f6-b5f6-80077c99d7d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:14.680506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a354457-47c0-4f89-83a4-9ec9de81d981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:14.686387 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a354457-47c0-4f89-83a4-9ec9de81d981 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:14.709044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 881/1782] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:31:14.710095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a354457-47c0-4f89-83a4-9ec9de81d981 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:14.723222 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a354457-47c0-4f89-83a4-9ec9de81d981 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:14.728603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a67cc9-013a-4e5d-b23f-16c3d637232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:14.729516 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a67cc9-013a-4e5d-b23f-16c3d637232a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:14.729930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a67cc9-013a-4e5d-b23f-16c3d637232a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:14.730408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a67cc9-013a-4e5d-b23f-16c3d637232a admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:14.731264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a67cc9-013a-4e5d-b23f-16c3d637232a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:14.733943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a67cc9-013a-4e5d-b23f-16c3d637232a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:14.772559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 882/1783] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:14 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:14.776703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a67cc9-013a-4e5d-b23f-16c3d637232a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:14.807786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6cc00-5c50-49f6-b5f6-80077c99d7d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:14.809415 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:14.810475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6cc00-5c50-49f6-b5f6-80077c99d7d6 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:14.839228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 902/1784] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:31:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:31:14.967122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a67cc9-013a-4e5d-b23f-16c3d637232a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:14.990193 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480efff9-e694-4185-bfb8-c3da367a1391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:14.991422 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480efff9-e694-4185-bfb8-c3da367a1391 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:14.991883 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480efff9-e694-4185-bfb8-c3da367a1391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:14.992259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480efff9-e694-4185-bfb8-c3da367a1391 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:14.993213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480efff9-e694-4185-bfb8-c3da367a1391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:14.995253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480efff9-e694-4185-bfb8-c3da367a1391 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:15.068484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 883/1785] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:14 2022] POST /identity/v3/users => generated 299 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:15.073082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6cc00-5c50-49f6-b5f6-80077c99d7d6 service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:15.092157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6cc00-5c50-49f6-b5f6-80077c99d7d6 service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:15.101967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5f15f-6bbd-4a34-ab24-3bfa21858df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:15.103118 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f15f-6bbd-4a34-ab24-3bfa21858df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:15.103593 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f15f-6bbd-4a34-ab24-3bfa21858df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:15.104299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f15f-6bbd-4a34-ab24-3bfa21858df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:15.105486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5f15f-6bbd-4a34-ab24-3bfa21858df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:15.107720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5f15f-6bbd-4a34-ab24-3bfa21858df9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:15.124290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 903/1786] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:31:15.128398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480efff9-e694-4185-bfb8-c3da367a1391 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:15.141717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480efff9-e694-4185-bfb8-c3da367a1391 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:15.148336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9be46a-2b9d-4695-ad5b-205dc266e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:15.149427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be46a-2b9d-4695-ad5b-205dc266e947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:15.149816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be46a-2b9d-4695-ad5b-205dc266e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:15.151396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be46a-2b9d-4695-ad5b-205dc266e947 admin admin] PATH_INFO: `/v3/projects/07ec06256ca0439babdda4be4e4f9036/users/ce3a689b57d1472998e420f343a4efbe/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:15.204657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9be46a-2b9d-4695-ad5b-205dc266e947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ec06256ca0439babdda4be4e4f9036, user_id=ce3a689b57d1472998e420f343a4efbe, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:15.209881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9be46a-2b9d-4695-ad5b-205dc266e947 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:15.231930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 884/1787] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:15 2022] PUT /identity/v3/projects/07ec06256ca0439babdda4be4e4f9036/users/ce3a689b57d1472998e420f343a4efbe/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:15.235734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5f15f-6bbd-4a34-ab24-3bfa21858df9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:15.256947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5f15f-6bbd-4a34-ab24-3bfa21858df9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:15.280347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:15.321142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9be46a-2b9d-4695-ad5b-205dc266e947 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:15.323032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ae9be46a-2b9d-4695-ad5b-205dc266e947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:15.361819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e3afb-4429-4241-ae44-b1e69d56f1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:15.364507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3afb-4429-4241-ae44-b1e69d56f1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:15.364881 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3afb-4429-4241-ae44-b1e69d56f1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:15.365247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3afb-4429-4241-ae44-b1e69d56f1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:15.366782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e3afb-4429-4241-ae44-b1e69d56f1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:15.385311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e3afb-4429-4241-ae44-b1e69d56f1f8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:15.415602 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 904/1788] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:15.417001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e3afb-4429-4241-ae44-b1e69d56f1f8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:15.427914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e3afb-4429-4241-ae44-b1e69d56f1f8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:15.434151 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed902c5e-bc6c-43e9-b6c0-fbe701c82a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:15.435190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed902c5e-bc6c-43e9-b6c0-fbe701c82a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:15.435537 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed902c5e-bc6c-43e9-b6c0-fbe701c82a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:15.436020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed902c5e-bc6c-43e9-b6c0-fbe701c82a81 admin admin] PATH_INFO: `/v3/projects/07ec06256ca0439babdda4be4e4f9036/users/ce3a689b57d1472998e420f343a4efbe/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:15.438335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed902c5e-bc6c-43e9-b6c0-fbe701c82a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ec06256ca0439babdda4be4e4f9036, user_id=ce3a689b57d1472998e420f343a4efbe, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:15.442688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed902c5e-bc6c-43e9-b6c0-fbe701c82a81 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:15.449332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9be46a-2b9d-4695-ad5b-205dc266e947 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:15.457341 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 905/1789] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:15 2022] PUT /identity/v3/projects/07ec06256ca0439babdda4be4e4f9036/users/ce3a689b57d1472998e420f343a4efbe/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:15.469210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f421e-b333-4f12-99b5-9d54cd5844d9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:15.469499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f421e-b333-4f12-99b5-9d54cd5844d9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:15.469769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f421e-b333-4f12-99b5-9d54cd5844d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:15.557984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-075f421e-b333-4f12-99b5-9d54cd5844d9 None None] MFA Rules not processed for user `ce3a689b57d1472998e420f343a4efbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:15.559241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-075f421e-b333-4f12-99b5-9d54cd5844d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:15.606994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:15.609436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:15.611017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:15.611579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] PATH_INFO: `/v3/projects/a20eefafd7b446be82be8f470dbc86d0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:15.619213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20eefafd7b446be82be8f470dbc86d0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:15.627830 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:15.664947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 906/1790] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:15.670999 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:15.680184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f421e-b333-4f12-99b5-9d54cd5844d9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:15.681638 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-075f421e-b333-4f12-99b5-9d54cd5844d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:15.692791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20eefafd7b446be82be8f470dbc86d0', 'request_id': 'req-80320526-b977-40b9-ab10-7a75616972a1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:15.706115 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20eefafd7b446be82be8f470dbc86d0', 'request_id': 'req-80320526-b977-40b9-ab10-7a75616972a1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:15.713155 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20eefafd7b446be82be8f470dbc86d0', 'request_id': 'req-80320526-b977-40b9-ab10-7a75616972a1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:15.725708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] The token cache is being invalidate because project a20eefafd7b446be82be8f470dbc86d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:15.726066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:15.726798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:15.728453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 885/1791] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:15 2022] DELETE /identity/v3/projects/a20eefafd7b446be82be8f470dbc86d0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:15.733025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:15.735293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:15.749368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f421e-b333-4f12-99b5-9d54cd5844d9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:15.794215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:15.804128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018059f2-9083-44a4-824b-bd156758496b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:15.804934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018059f2-9083-44a4-824b-bd156758496b service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:15.805320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018059f2-9083-44a4-824b-bd156758496b service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:15.805706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018059f2-9083-44a4-824b-bd156758496b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:15.807859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-018059f2-9083-44a4-824b-bd156758496b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:15.810130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320526-b977-40b9-ab10-7a75616972a1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:15.815857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6161ca-9bcb-4814-a5c4-e64d03c4d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:15.816759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6161ca-9bcb-4814-a5c4-e64d03c4d3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:15.817065 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6161ca-9bcb-4814-a5c4-e64d03c4d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:15.817337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6161ca-9bcb-4814-a5c4-e64d03c4d3e9 admin admin] PATH_INFO: `/v3/users/bb08c57cf33847efb27b297e896f1d6a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:15.818876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6161ca-9bcb-4814-a5c4-e64d03c4d3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb08c57cf33847efb27b297e896f1d6a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:15.820504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6161ca-9bcb-4814-a5c4-e64d03c4d3e9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:15.870587 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a6161ca-9bcb-4814-a5c4-e64d03c4d3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb08c57cf33847efb27b297e896f1d6a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:15.875881 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018059f2-9083-44a4-824b-bd156758496b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:15.877775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018059f2-9083-44a4-824b-bd156758496b service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:15.884998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a6161ca-9bcb-4814-a5c4-e64d03c4d3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb08c57cf33847efb27b297e896f1d6a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:15.886468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a6161ca-9bcb-4814-a5c4-e64d03c4d3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb08c57cf33847efb27b297e896f1d6a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:15.886468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a6161ca-9bcb-4814-a5c4-e64d03c4d3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb08c57cf33847efb27b297e896f1d6a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:15.895056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 907/1792] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:31:15.902644 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a6161ca-9bcb-4814-a5c4-e64d03c4d3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb08c57cf33847efb27b297e896f1d6a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:15.916052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 886/1793] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:15 2022] DELETE /identity/v3/users/bb08c57cf33847efb27b297e896f1d6a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:16.046850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018059f2-9083-44a4-824b-bd156758496b service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:16.048268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-018059f2-9083-44a4-824b-bd156758496b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:16.061495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018059f2-9083-44a4-824b-bd156758496b service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:16.125800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:16.126629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:16.126965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:16.127194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] PATH_INFO: `/v3/users/b276ac033d0b431a866bcbfe3b811e67` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:16.128567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b276ac033d0b431a866bcbfe3b811e67)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:16.130623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:16.188439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b276ac033d0b431a866bcbfe3b811e67'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:16.201250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b276ac033d0b431a866bcbfe3b811e67'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:16.203307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b276ac033d0b431a866bcbfe3b811e67'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:16.215399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b276ac033d0b431a866bcbfe3b811e67'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:16.225173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b276ac033d0b431a866bcbfe3b811e67'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:16.232517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 908/1794] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:16 2022] DELETE /identity/v3/users/b276ac033d0b431a866bcbfe3b811e67 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:16.237406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d609bf-2d13-42f8-8d7c-dc5607d23ee6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:16.237700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d609bf-2d13-42f8-8d7c-dc5607d23ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:16.238384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d609bf-2d13-42f8-8d7c-dc5607d23ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:16.249236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:16.251932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:16.266319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-26d609bf-2d13-42f8-8d7c-dc5607d23ee6 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:16.267845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-26d609bf-2d13-42f8-8d7c-dc5607d23ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:16.282697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:16.329380 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:16.369435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205e344-85ee-4c83-9859-00b871ba32fe admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:16.375291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 887/1795] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:16.375522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:16.376643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:16.377092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:16.377526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] PATH_INFO: `/v3/projects/6b32b333c6224f10874b32396c02cc97` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:16.382688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b32b333c6224f10874b32396c02cc97)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:16.384714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:16.384836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d609bf-2d13-42f8-8d7c-dc5607d23ee6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:16.386095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-26d609bf-2d13-42f8-8d7c-dc5607d23ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:16.503458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d609bf-2d13-42f8-8d7c-dc5607d23ee6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:16.556773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b32b333c6224f10874b32396c02cc97', 'request_id': 'req-aa4c56f9-6128-4792-804a-8dd3c418e8ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:16.575246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b32b333c6224f10874b32396c02cc97', 'request_id': 'req-aa4c56f9-6128-4792-804a-8dd3c418e8ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:16.595491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b32b333c6224f10874b32396c02cc97', 'request_id': 'req-aa4c56f9-6128-4792-804a-8dd3c418e8ac'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:16.641638 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] The token cache is being invalidate because project 6b32b333c6224f10874b32396c02cc97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:16.641915 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:16.643441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aa4c56f9-6128-4792-804a-8dd3c418e8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:16.646842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 909/1796] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:16 2022] DELETE /identity/v3/projects/6b32b333c6224f10874b32396c02cc97 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:16.655489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3ed66-6609-4d50-b739-80be9646c06c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:16.657388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3ed66-6609-4d50-b739-80be9646c06c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:16.657388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3ed66-6609-4d50-b739-80be9646c06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:16.680646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-09f3ed66-6609-4d50-b739-80be9646c06c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:16.682416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-09f3ed66-6609-4d50-b739-80be9646c06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:16.715897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30f3f8-5dae-4805-a095-04ab4cbdbf18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:16.718227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30f3f8-5dae-4805-a095-04ab4cbdbf18 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:16.719533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30f3f8-5dae-4805-a095-04ab4cbdbf18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:16.719906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30f3f8-5dae-4805-a095-04ab4cbdbf18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:16.728094 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ea30f3f8-5dae-4805-a095-04ab4cbdbf18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:16.755214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 910/1797] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:16.767946 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075feb-f2ba-4b3a-a1dd-f7e4d97a3ab1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:16.769209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075feb-f2ba-4b3a-a1dd-f7e4d97a3ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:16.770544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075feb-f2ba-4b3a-a1dd-f7e4d97a3ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:16.780402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30f3f8-5dae-4805-a095-04ab4cbdbf18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:16.782848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30f3f8-5dae-4805-a095-04ab4cbdbf18 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:16.800179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3b075feb-f2ba-4b3a-a1dd-f7e4d97a3ab1 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:16.801526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3b075feb-f2ba-4b3a-a1dd-f7e4d97a3ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:16.816984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 911/1799] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:16.820108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b075feb-f2ba-4b3a-a1dd-f7e4d97a3ab1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:16.820915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 888/1799] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:16.861913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b075feb-f2ba-4b3a-a1dd-f7e4d97a3ab1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:16.884734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b52bee-0162-4b2d-8f8b-e795324baa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:16.885954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b52bee-0162-4b2d-8f8b-e795324baa0a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:16.886235 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b52bee-0162-4b2d-8f8b-e795324baa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:16.886507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b52bee-0162-4b2d-8f8b-e795324baa0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:16.889232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b52bee-0162-4b2d-8f8b-e795324baa0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:16.889505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b52bee-0162-4b2d-8f8b-e795324baa0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:16.891189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b52bee-0162-4b2d-8f8b-e795324baa0a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:16.955436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 912/1800] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:16.956192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30f3f8-5dae-4805-a095-04ab4cbdbf18 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:16.987947 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30f3f8-5dae-4805-a095-04ab4cbdbf18 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:17.001357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d93fa-51c6-441e-b609-944ec1ba2f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:17.002006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d93fa-51c6-441e-b609-944ec1ba2f96 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:17.002359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d93fa-51c6-441e-b609-944ec1ba2f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:17.002636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d93fa-51c6-441e-b609-944ec1ba2f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:17.003505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d93fa-51c6-441e-b609-944ec1ba2f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:17.010186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d93fa-51c6-441e-b609-944ec1ba2f96 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:17.088430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 889/1801] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:16 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:17.092274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b52bee-0162-4b2d-8f8b-e795324baa0a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:17.105387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b52bee-0162-4b2d-8f8b-e795324baa0a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:17.154507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:17.205906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70e5d8-d5eb-4186-aba2-d575ae12dadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:17.207347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70e5d8-d5eb-4186-aba2-d575ae12dadc admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:17.207462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70e5d8-d5eb-4186-aba2-d575ae12dadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:17.207683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70e5d8-d5eb-4186-aba2-d575ae12dadc admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:17.208385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70e5d8-d5eb-4186-aba2-d575ae12dadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:17.210858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70e5d8-d5eb-4186-aba2-d575ae12dadc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:17.242226 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 913/1802] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:17 2022] POST /identity/v3/users => generated 282 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:17.249343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d93fa-51c6-441e-b609-944ec1ba2f96 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:17.261545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d93fa-51c6-441e-b609-944ec1ba2f96 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:17.272485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c06f9-ea37-4524-a705-27bf19e824ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:17.273609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c06f9-ea37-4524-a705-27bf19e824ea admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:17.274181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c06f9-ea37-4524-a705-27bf19e824ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:17.274532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c06f9-ea37-4524-a705-27bf19e824ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:17.275419 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c06f9-ea37-4524-a705-27bf19e824ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:17.277340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c06f9-ea37-4524-a705-27bf19e824ea admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:17.293004 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70e5d8-d5eb-4186-aba2-d575ae12dadc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:17.293565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 890/1803] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:17.297810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c06f9-ea37-4524-a705-27bf19e824ea admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:17.299316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bb70e5d8-d5eb-4186-aba2-d575ae12dadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:17.314885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c06f9-ea37-4524-a705-27bf19e824ea admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:17.315082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70e5d8-d5eb-4186-aba2-d575ae12dadc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:17.320683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:17.321209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dff29-043b-4bc8-a8bd-42138c438732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:17.321819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:17.321961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dff29-043b-4bc8-a8bd-42138c438732 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:17.322186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dff29-043b-4bc8-a8bd-42138c438732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:17.322318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:17.322547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] PATH_INFO: `/v3/projects/6a525c64d79f4366acde3fc00617fb92` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:17.322646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dff29-043b-4bc8-a8bd-42138c438732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:17.323500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dff29-043b-4bc8-a8bd-42138c438732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:17.324054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a525c64d79f4366acde3fc00617fb92)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:17.325720 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dff29-043b-4bc8-a8bd-42138c438732 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:17.326183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:17.345145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 891/1804] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:31:17.349125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dff29-043b-4bc8-a8bd-42138c438732 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:17.359885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dff29-043b-4bc8-a8bd-42138c438732 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:17.373760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277475e-1f1a-49e5-8308-94aee5978b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:17.374826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277475e-1f1a-49e5-8308-94aee5978b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:17.375182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277475e-1f1a-49e5-8308-94aee5978b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:17.375533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277475e-1f1a-49e5-8308-94aee5978b85 admin admin] PATH_INFO: `/v3/projects/d59f290acd314d1f8cf935eb351bbec4/users/a76dbc21a9a14392bea441d48678a954/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:17.390657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a525c64d79f4366acde3fc00617fb92', 'request_id': 'req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:17.402681 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a525c64d79f4366acde3fc00617fb92', 'request_id': 'req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:17.406020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277475e-1f1a-49e5-8308-94aee5978b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59f290acd314d1f8cf935eb351bbec4, user_id=a76dbc21a9a14392bea441d48678a954, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:17.410232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a525c64d79f4366acde3fc00617fb92', 'request_id': 'req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:17.411187 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277475e-1f1a-49e5-8308-94aee5978b85 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:17.429285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] The token cache is being invalidate because project 6a525c64d79f4366acde3fc00617fb92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:17.429570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:17.430303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4dbf6895-79e8-41c7-b1ab-f1ffb8b89678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:17.431986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 892/1805] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:17 2022] PUT /identity/v3/projects/d59f290acd314d1f8cf935eb351bbec4/users/a76dbc21a9a14392bea441d48678a954/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:17.432168 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 914/1806] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:17 2022] DELETE /identity/v3/projects/6a525c64d79f4366acde3fc00617fb92 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:17.435933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277475e-1f1a-49e5-8308-94aee5978b85 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:17.437604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2277475e-1f1a-49e5-8308-94aee5978b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:17.443718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7273bfc-4eab-416c-95d1-c035bf730b7b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:17.444013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7273bfc-4eab-416c-95d1-c035bf730b7b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:17.444285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7273bfc-4eab-416c-95d1-c035bf730b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:17.475230 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:17.481318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e7273bfc-4eab-416c-95d1-c035bf730b7b None None] MFA Rules not processed for user `a76dbc21a9a14392bea441d48678a954`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:17.482732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e7273bfc-4eab-416c-95d1-c035bf730b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:17.532917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277475e-1f1a-49e5-8308-94aee5978b85 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:17.555182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:17.557005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:17.558724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:17.559519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] PATH_INFO: `/v3/users/ce3a689b57d1472998e420f343a4efbe` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:17.561912 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3a689b57d1472998e420f343a4efbe)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:17.564247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:17.582188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 915/1807] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:17.586642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7273bfc-4eab-416c-95d1-c035bf730b7b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:17.588361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e7273bfc-4eab-416c-95d1-c035bf730b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:17.606401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7273bfc-4eab-416c-95d1-c035bf730b7b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:17.613635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fb924-40b2-41c8-a407-fbac3a22aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:17.614513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb924-40b2-41c8-a407-fbac3a22aa44 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:17.614926 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb924-40b2-41c8-a407-fbac3a22aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:17.615663 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb924-40b2-41c8-a407-fbac3a22aa44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:17.616702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fb924-40b2-41c8-a407-fbac3a22aa44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:17.619551 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fb924-40b2-41c8-a407-fbac3a22aa44 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:17.647283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3a689b57d1472998e420f343a4efbe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:17.664127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3a689b57d1472998e420f343a4efbe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:17.664906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3a689b57d1472998e420f343a4efbe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:17.665544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3a689b57d1472998e420f343a4efbe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:17.677395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3a689b57d1472998e420f343a4efbe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:17.677539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 916/1808] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:17 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:17.681237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fb924-40b2-41c8-a407-fbac3a22aa44 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:17.685611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b4fb924-40b2-41c8-a407-fbac3a22aa44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:17.699411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 893/1809] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:17 2022] DELETE /identity/v3/users/ce3a689b57d1472998e420f343a4efbe => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:17.713936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:17.867990 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fb924-40b2-41c8-a407-fbac3a22aa44 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:18.101130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36360f70-0085-4e57-887f-672b74a29b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:18.101853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36360f70-0085-4e57-887f-672b74a29b8b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.102132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36360f70-0085-4e57-887f-672b74a29b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.102402 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36360f70-0085-4e57-887f-672b74a29b8b admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.103127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36360f70-0085-4e57-887f-672b74a29b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:18.105115 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36360f70-0085-4e57-887f-672b74a29b8b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:18.171961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 917/1810] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:17 2022] POST /identity/v3/users => generated 289 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:18.176720 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:18.191964 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cc123-e444-4032-8b92-e8a8bf073ced admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:18.208379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decf40c-43e9-4ab1-b97e-f5c0c037da02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:18.211570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decf40c-43e9-4ab1-b97e-f5c0c037da02 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.211887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decf40c-43e9-4ab1-b97e-f5c0c037da02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.212312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decf40c-43e9-4ab1-b97e-f5c0c037da02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.212882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decf40c-43e9-4ab1-b97e-f5c0c037da02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:18.222408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decf40c-43e9-4ab1-b97e-f5c0c037da02 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:18.248027 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 894/1811] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:18.252275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36360f70-0085-4e57-887f-672b74a29b8b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:18.269378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36360f70-0085-4e57-887f-672b74a29b8b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:18.283745 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e607d6-0fc3-46ce-9e23-366822cc7e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:18.284682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e607d6-0fc3-46ce-9e23-366822cc7e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.284983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e607d6-0fc3-46ce-9e23-366822cc7e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.285269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e607d6-0fc3-46ce-9e23-366822cc7e3b admin admin] PATH_INFO: `/v3/projects/dcb0ffc75e32492ba629f999ab720a5a/users/85d8a258c0bd48e88dfac2d3a14555f4/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.326999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e607d6-0fc3-46ce-9e23-366822cc7e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb0ffc75e32492ba629f999ab720a5a, user_id=85d8a258c0bd48e88dfac2d3a14555f4, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:18.337034 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e607d6-0fc3-46ce-9e23-366822cc7e3b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:18.349805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 918/1812] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:18 2022] PUT /identity/v3/projects/dcb0ffc75e32492ba629f999ab720a5a/users/85d8a258c0bd48e88dfac2d3a14555f4/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:18.354134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decf40c-43e9-4ab1-b97e-f5c0c037da02 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:18.367288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e607d6-0fc3-46ce-9e23-366822cc7e3b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:18.370462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decf40c-43e9-4ab1-b97e-f5c0c037da02 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:18.371957 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a1e607d6-0fc3-46ce-9e23-366822cc7e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:18.444905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01dd26-e8d7-4760-bba2-16e04ea5c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:18.445900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01dd26-e8d7-4760-bba2-16e04ea5c842 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.446029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01dd26-e8d7-4760-bba2-16e04ea5c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.446224 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01dd26-e8d7-4760-bba2-16e04ea5c842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.447047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01dd26-e8d7-4760-bba2-16e04ea5c842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:18.449201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01dd26-e8d7-4760-bba2-16e04ea5c842 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:18.466052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 895/1813] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:18.467279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e607d6-0fc3-46ce-9e23-366822cc7e3b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:18.467398 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01dd26-e8d7-4760-bba2-16e04ea5c842 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:18.473454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:18.474346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.474631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.474935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] PATH_INFO: `/v3/projects/07ec06256ca0439babdda4be4e4f9036` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.476759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ec06256ca0439babdda4be4e4f9036)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:18.478998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:18.484806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01dd26-e8d7-4760-bba2-16e04ea5c842 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:18.491180 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ee7b7-75f2-4141-99c2-fe00353eda50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:18.492302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ee7b7-75f2-4141-99c2-fe00353eda50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.492424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ee7b7-75f2-4141-99c2-fe00353eda50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.492857 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ee7b7-75f2-4141-99c2-fe00353eda50 admin admin] PATH_INFO: `/v3/projects/dcb0ffc75e32492ba629f999ab720a5a/users/85d8a258c0bd48e88dfac2d3a14555f4/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.496193 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ee7b7-75f2-4141-99c2-fe00353eda50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb0ffc75e32492ba629f999ab720a5a, user_id=85d8a258c0bd48e88dfac2d3a14555f4, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:18.498593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ee7b7-75f2-4141-99c2-fe00353eda50 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:18.505094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:18.513807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 896/1814] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:18 2022] PUT /identity/v3/projects/dcb0ffc75e32492ba629f999ab720a5a/users/85d8a258c0bd48e88dfac2d3a14555f4/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:18.525229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d346a-78a6-4b8e-a7de-90c7353c14e4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.525553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d346a-78a6-4b8e-a7de-90c7353c14e4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.527198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d346a-78a6-4b8e-a7de-90c7353c14e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.550902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ec06256ca0439babdda4be4e4f9036', 'request_id': 'req-138d13f2-0801-4518-ad20-1a6ca76973c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:18.560707 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ec06256ca0439babdda4be4e4f9036', 'request_id': 'req-138d13f2-0801-4518-ad20-1a6ca76973c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:18.567258 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8e4d346a-78a6-4b8e-a7de-90c7353c14e4 None None] MFA Rules not processed for user `85d8a258c0bd48e88dfac2d3a14555f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:18.568749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8e4d346a-78a6-4b8e-a7de-90c7353c14e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:18.570140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ec06256ca0439babdda4be4e4f9036', 'request_id': 'req-138d13f2-0801-4518-ad20-1a6ca76973c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:18.574758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:18.589669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] The token cache is being invalidate because project 07ec06256ca0439babdda4be4e4f9036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:18.589972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:18.590680 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-138d13f2-0801-4518-ad20-1a6ca76973c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:18.599372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 919/1815] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:18 2022] DELETE /identity/v3/projects/07ec06256ca0439babdda4be4e4f9036 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:18.599749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503e02b-e5fd-457c-9ae3-450faff87a5d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.600135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503e02b-e5fd-457c-9ae3-450faff87a5d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.600420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503e02b-e5fd-457c-9ae3-450faff87a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.628091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d503e02b-e5fd-457c-9ae3-450faff87a5d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:18.629814 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d503e02b-e5fd-457c-9ae3-450faff87a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:18.660414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 897/1816] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:18.671609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d346a-78a6-4b8e-a7de-90c7353c14e4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:18.673119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8e4d346a-78a6-4b8e-a7de-90c7353c14e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:18.705355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 920/1817] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:18.713843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311b6d-d79c-4b13-886e-7ffa609494f3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.714024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311b6d-d79c-4b13-886e-7ffa609494f3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.714280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311b6d-d79c-4b13-886e-7ffa609494f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.736616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f7311b6d-d79c-4b13-886e-7ffa609494f3 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:18.738283 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f7311b6d-d79c-4b13-886e-7ffa609494f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:18.742724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d346a-78a6-4b8e-a7de-90c7353c14e4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:18.749177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba052bb-dbc1-4c9f-a177-ae05377daac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:18.750848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba052bb-dbc1-4c9f-a177-ae05377daac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.751233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba052bb-dbc1-4c9f-a177-ae05377daac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.751501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba052bb-dbc1-4c9f-a177-ae05377daac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.759848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 921/1818] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:18.764463 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7311b6d-d79c-4b13-886e-7ffa609494f3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:18.765551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba052bb-dbc1-4c9f-a177-ae05377daac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:18.767668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba052bb-dbc1-4c9f-a177-ae05377daac3 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:18.781653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 898/1819] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:31:18.785426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7311b6d-d79c-4b13-886e-7ffa609494f3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:18.809625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6e206-7731-4b18-b488-bb8334c7a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:18.814159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6e206-7731-4b18-b488-bb8334c7a2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.814675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6e206-7731-4b18-b488-bb8334c7a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.815224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6e206-7731-4b18-b488-bb8334c7a2d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.817148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6e206-7731-4b18-b488-bb8334c7a2d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:18.818440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6e206-7731-4b18-b488-bb8334c7a2d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:18.820915 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6e206-7731-4b18-b488-bb8334c7a2d9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:18.846497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 922/1820] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:18.851071 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba052bb-dbc1-4c9f-a177-ae05377daac3 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:18.862441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba052bb-dbc1-4c9f-a177-ae05377daac3 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:18.868389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2db73-8f23-44e6-b8ce-29c8fb11056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:18.869241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2db73-8f23-44e6-b8ce-29c8fb11056b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.869680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2db73-8f23-44e6-b8ce-29c8fb11056b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.869874 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2db73-8f23-44e6-b8ce-29c8fb11056b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.870590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2db73-8f23-44e6-b8ce-29c8fb11056b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:18.872648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2db73-8f23-44e6-b8ce-29c8fb11056b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:18.900862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6e206-7731-4b18-b488-bb8334c7a2d9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:18.913568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6e206-7731-4b18-b488-bb8334c7a2d9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:18.913699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 899/1821] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:18 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:18.914727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2db73-8f23-44e6-b8ce-29c8fb11056b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:18.966227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06395b-8259-48f7-bde8-9524ab1a1e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:18.966900 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06395b-8259-48f7-bde8-9524ab1a1e05 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:18.967320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06395b-8259-48f7-bde8-9524ab1a1e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:18.967606 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06395b-8259-48f7-bde8-9524ab1a1e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:18.969859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3f06395b-8259-48f7-bde8-9524ab1a1e05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:19.003504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2db73-8f23-44e6-b8ce-29c8fb11056b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:19.014547 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b947ed-2f25-4df9-8548-350eb887d671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:19.015522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b947ed-2f25-4df9-8548-350eb887d671 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.015811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b947ed-2f25-4df9-8548-350eb887d671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:19.016818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b947ed-2f25-4df9-8548-350eb887d671 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:19.017720 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b947ed-2f25-4df9-8548-350eb887d671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:19.020088 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b947ed-2f25-4df9-8548-350eb887d671 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:19.043340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:19.080063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 900/1822] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:18 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:19.084134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b947ed-2f25-4df9-8548-350eb887d671 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:19.105997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06395b-8259-48f7-bde8-9524ab1a1e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:19.107462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06395b-8259-48f7-bde8-9524ab1a1e05 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:19.108097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b947ed-2f25-4df9-8548-350eb887d671 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:19.114484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503fec3-e987-4f84-bc2e-9158fceba157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:19.116636 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503fec3-e987-4f84-bc2e-9158fceba157 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.117528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503fec3-e987-4f84-bc2e-9158fceba157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:19.118018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503fec3-e987-4f84-bc2e-9158fceba157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:19.118761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 923/1823] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:31:19.119311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503fec3-e987-4f84-bc2e-9158fceba157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:19.121257 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503fec3-e987-4f84-bc2e-9158fceba157 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:19.134136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 901/1824] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:31:19.143502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06395b-8259-48f7-bde8-9524ab1a1e05 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:19.161082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06395b-8259-48f7-bde8-9524ab1a1e05 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:19.168036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa83c3-45c0-43dc-88ab-1a8fcbf05cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:19.168732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa83c3-45c0-43dc-88ab-1a8fcbf05cab admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.169048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa83c3-45c0-43dc-88ab-1a8fcbf05cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:19.169348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa83c3-45c0-43dc-88ab-1a8fcbf05cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:19.170218 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa83c3-45c0-43dc-88ab-1a8fcbf05cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:19.171907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa83c3-45c0-43dc-88ab-1a8fcbf05cab admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:19.184365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 924/1825] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:19.188826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503fec3-e987-4f84-bc2e-9158fceba157 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:19.194670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:19.201765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503fec3-e987-4f84-bc2e-9158fceba157 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:19.206920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f81402-3fb5-4f16-be56-fbf12c1dac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:19.207838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f81402-3fb5-4f16-be56-fbf12c1dac76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.208126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f81402-3fb5-4f16-be56-fbf12c1dac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:19.208399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f81402-3fb5-4f16-be56-fbf12c1dac76 admin admin] PATH_INFO: `/v3/projects/289256172bdc4b9086ac55e7a477a75b/users/de9c497dda044d2d9768b06b40921877/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:19.229844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f81402-3fb5-4f16-be56-fbf12c1dac76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=289256172bdc4b9086ac55e7a477a75b, user_id=de9c497dda044d2d9768b06b40921877, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:19.233942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f81402-3fb5-4f16-be56-fbf12c1dac76 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:19.257461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 902/1826] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:19 2022] PUT /identity/v3/projects/289256172bdc4b9086ac55e7a477a75b/users/de9c497dda044d2d9768b06b40921877/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:19.272454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb21755-e66f-441e-aafe-1dfba09eac21 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.273182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb21755-e66f-441e-aafe-1dfba09eac21 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:19.273655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb21755-e66f-441e-aafe-1dfba09eac21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:19.304400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bbb21755-e66f-441e-aafe-1dfba09eac21 None None] MFA Rules not processed for user `de9c497dda044d2d9768b06b40921877`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:19.305677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bbb21755-e66f-441e-aafe-1dfba09eac21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:19.389501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 925/1827] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:19.396125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f81402-3fb5-4f16-be56-fbf12c1dac76 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:19.494959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f81402-3fb5-4f16-be56-fbf12c1dac76 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:19.503195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15188d2-d9d3-4e70-bc22-d6b1b3cea8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:19.504243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15188d2-d9d3-4e70-bc22-d6b1b3cea8db admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.504914 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15188d2-d9d3-4e70-bc22-d6b1b3cea8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:19.505402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15188d2-d9d3-4e70-bc22-d6b1b3cea8db admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:19.506861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15188d2-d9d3-4e70-bc22-d6b1b3cea8db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:19.513542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15188d2-d9d3-4e70-bc22-d6b1b3cea8db admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:19.567737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 903/1828] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:19 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:19.569618 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb21755-e66f-441e-aafe-1dfba09eac21 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:19.590712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb21755-e66f-441e-aafe-1dfba09eac21 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:19.670756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7c55f-93af-456b-b8f3-2a2d2e6cb3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:19.671505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c55f-93af-456b-b8f3-2a2d2e6cb3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.671781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c55f-93af-456b-b8f3-2a2d2e6cb3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:19.672049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c55f-93af-456b-b8f3-2a2d2e6cb3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:19.672740 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7c55f-93af-456b-b8f3-2a2d2e6cb3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:19.674779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7c55f-93af-456b-b8f3-2a2d2e6cb3c8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:19.698867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 926/1829] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:19 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:19.702236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15188d2-d9d3-4e70-bc22-d6b1b3cea8db admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:19.713095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15188d2-d9d3-4e70-bc22-d6b1b3cea8db admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:19.719763 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1073a0-fe2c-45fe-b4b2-d4d8b459b315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:19.720489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1073a0-fe2c-45fe-b4b2-d4d8b459b315 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.720801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1073a0-fe2c-45fe-b4b2-d4d8b459b315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:19.721090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1073a0-fe2c-45fe-b4b2-d4d8b459b315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:19.721921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1073a0-fe2c-45fe-b4b2-d4d8b459b315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:19.723707 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1073a0-fe2c-45fe-b4b2-d4d8b459b315 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:19.745174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 904/1830] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:19.746365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7c55f-93af-456b-b8f3-2a2d2e6cb3c8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:19.757643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7c55f-93af-456b-b8f3-2a2d2e6cb3c8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:19.763945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f68c7-edb6-469c-9096-c7a24f56de00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:19.765759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f68c7-edb6-469c-9096-c7a24f56de00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.766380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f68c7-edb6-469c-9096-c7a24f56de00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:19.766870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f68c7-edb6-469c-9096-c7a24f56de00 admin admin] PATH_INFO: `/v3/projects/1863358261474766818c7d0ac1f002ab/users/943e18d8ba2448dea65966496b53075e/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:19.792190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f68c7-edb6-469c-9096-c7a24f56de00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1863358261474766818c7d0ac1f002ab, user_id=943e18d8ba2448dea65966496b53075e, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:19.796799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f68c7-edb6-469c-9096-c7a24f56de00 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:19.824515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 927/1831] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:19 2022] PUT /identity/v3/projects/1863358261474766818c7d0ac1f002ab/users/943e18d8ba2448dea65966496b53075e/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:19.828802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1073a0-fe2c-45fe-b4b2-d4d8b459b315 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:19.848033 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1073a0-fe2c-45fe-b4b2-d4d8b459b315 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:19.926747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e282237-6d72-4d54-9c08-a2c2b656b7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:19.927467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e282237-6d72-4d54-9c08-a2c2b656b7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.927815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e282237-6d72-4d54-9c08-a2c2b656b7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:19.928090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e282237-6d72-4d54-9c08-a2c2b656b7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:19.928928 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e282237-6d72-4d54-9c08-a2c2b656b7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:19.931866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e282237-6d72-4d54-9c08-a2c2b656b7d3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:19.948622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 905/1832] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:19.953128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f68c7-edb6-469c-9096-c7a24f56de00 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:19.964917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f68c7-edb6-469c-9096-c7a24f56de00 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:19.969866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db0306-a6fd-4be6-9157-7320a473fcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:19.970819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db0306-a6fd-4be6-9157-7320a473fcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.971185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db0306-a6fd-4be6-9157-7320a473fcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:19.971460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db0306-a6fd-4be6-9157-7320a473fcd3 admin admin] PATH_INFO: `/v3/projects/1863358261474766818c7d0ac1f002ab/users/943e18d8ba2448dea65966496b53075e/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:19.973706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db0306-a6fd-4be6-9157-7320a473fcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1863358261474766818c7d0ac1f002ab, user_id=943e18d8ba2448dea65966496b53075e, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:19.976685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db0306-a6fd-4be6-9157-7320a473fcd3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:19.988488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 928/1833] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:19 2022] PUT /identity/v3/projects/1863358261474766818c7d0ac1f002ab/users/943e18d8ba2448dea65966496b53075e/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:19.999652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e017ef4-8952-4098-a6a2-9c8b3faee02b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:19.999865 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e017ef4-8952-4098-a6a2-9c8b3faee02b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:20.000145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e017ef4-8952-4098-a6a2-9c8b3faee02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:20.029494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0e017ef4-8952-4098-a6a2-9c8b3faee02b None None] MFA Rules not processed for user `943e18d8ba2448dea65966496b53075e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:20.030813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0e017ef4-8952-4098-a6a2-9c8b3faee02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:20.096793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:20.170761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 906/1834] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:20.251234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db0306-a6fd-4be6-9157-7320a473fcd3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:20.276290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:20.380621 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db0306-a6fd-4be6-9157-7320a473fcd3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:20.385117 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b2ff7-16e4-4348-8ff3-7826c1e4d3d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:20.386317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b2ff7-16e4-4348-8ff3-7826c1e4d3d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:20.386648 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b2ff7-16e4-4348-8ff3-7826c1e4d3d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:20.386972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b2ff7-16e4-4348-8ff3-7826c1e4d3d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:20.512794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b2ff7-16e4-4348-8ff3-7826c1e4d3d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:20.529971 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b2ff7-16e4-4348-8ff3-7826c1e4d3d9 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:20.561612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 929/1835] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:30.009403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992684f9-5daf-4682-8c4e-27e1d5f7d034 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:30.010052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992684f9-5daf-4682-8c4e-27e1d5f7d034 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:30.010052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992684f9-5daf-4682-8c4e-27e1d5f7d034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:30.053976 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-992684f9-5daf-4682-8c4e-27e1d5f7d034 None None] MFA Rules not processed for user `1c5ad3094ee04495a6ab82c92d458aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:30.054891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-992684f9-5daf-4682-8c4e-27e1d5f7d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:30.122492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 907/1836] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Jul 6 20:31:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:30.179527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b2ff7-16e4-4348-8ff3-7826c1e4d3d9 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:30.181014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d98b2ff7-16e4-4348-8ff3-7826c1e4d3d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:30.192865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b2ff7-16e4-4348-8ff3-7826c1e4d3d9 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:30.196677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d123925-4da9-4489-8e81-5d2e29fbfac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:30.197468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d123925-4da9-4489-8e81-5d2e29fbfac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:30.197747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d123925-4da9-4489-8e81-5d2e29fbfac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:30.198016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d123925-4da9-4489-8e81-5d2e29fbfac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:30.205573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d123925-4da9-4489-8e81-5d2e29fbfac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:30.207017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d123925-4da9-4489-8e81-5d2e29fbfac4 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:30.215080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 930/1837] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:30.446421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992684f9-5daf-4682-8c4e-27e1d5f7d034 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:30.458024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992684f9-5daf-4682-8c4e-27e1d5f7d034 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:30.466889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a86a4b-ac76-40d3-b410-69fadf9595dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:30.467940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a86a4b-ac76-40d3-b410-69fadf9595dc service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:30.468802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a86a4b-ac76-40d3-b410-69fadf9595dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:30.468802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a86a4b-ac76-40d3-b410-69fadf9595dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:30.493159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a86a4b-ac76-40d3-b410-69fadf9595dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:30.494730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a86a4b-ac76-40d3-b410-69fadf9595dc service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:30.505628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 908/1838] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:32.574577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c7d8b-cb2b-4b8c-9e1b-8504e7366df3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:32.574577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c7d8b-cb2b-4b8c-9e1b-8504e7366df3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:32.574577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c7d8b-cb2b-4b8c-9e1b-8504e7366df3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:32.574577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 931/1839] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:31:32.598543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daa67-9c9d-41ff-9ea7-de319eb73714 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:32.599150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daa67-9c9d-41ff-9ea7-de319eb73714 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:32.599150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daa67-9c9d-41ff-9ea7-de319eb73714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:32.639146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d54daa67-9c9d-41ff-9ea7-de319eb73714 None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:32.643218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d54daa67-9c9d-41ff-9ea7-de319eb73714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:32.797938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 909/1840] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:31:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:32.899742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c7d8b-cb2b-4b8c-9e1b-8504e7366df3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:32.903073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6b9c7d8b-cb2b-4b8c-9e1b-8504e7366df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:32.924403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c7d8b-cb2b-4b8c-9e1b-8504e7366df3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:32.931262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146dc9e-304a-4112-a87b-472333f0d37d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:32.932784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146dc9e-304a-4112-a87b-472333f0d37d service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:32.933293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146dc9e-304a-4112-a87b-472333f0d37d service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:32.933708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146dc9e-304a-4112-a87b-472333f0d37d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:32.950493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146dc9e-304a-4112-a87b-472333f0d37d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:32.952186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146dc9e-304a-4112-a87b-472333f0d37d service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:32.964891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 932/1841] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:36.002660 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd189-8024-4419-a78f-4e8011ed3eda None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:36.003638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd189-8024-4419-a78f-4e8011ed3eda None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:36.004078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd189-8024-4419-a78f-4e8011ed3eda None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:36.007130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 910/1842] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:31:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:31:36.034529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5e36e-d6f7-4ec6-a0e2-5d9849047597 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:36.035566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5e36e-d6f7-4ec6-a0e2-5d9849047597 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:36.036251 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5e36e-d6f7-4ec6-a0e2-5d9849047597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:36.115784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-04a5e36e-d6f7-4ec6-a0e2-5d9849047597 None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:36.122043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-04a5e36e-d6f7-4ec6-a0e2-5d9849047597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:36.136897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 933/1843] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:31:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:36.155180 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cd189-8024-4419-a78f-4e8011ed3eda None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:36.183520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cd189-8024-4419-a78f-4e8011ed3eda None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:36.193618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cdbb2-b074-43b8-a303-1cc38335395f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:36.194386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cdbb2-b074-43b8-a303-1cc38335395f service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:36.194878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cdbb2-b074-43b8-a303-1cc38335395f service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:36.195748 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cdbb2-b074-43b8-a303-1cc38335395f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:36.210706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cdbb2-b074-43b8-a303-1cc38335395f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:36.213059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cdbb2-b074-43b8-a303-1cc38335395f service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:36.255259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 911/1844] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:36.507910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5e36e-d6f7-4ec6-a0e2-5d9849047597 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:36.510195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-04a5e36e-d6f7-4ec6-a0e2-5d9849047597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:36.587639 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5e36e-d6f7-4ec6-a0e2-5d9849047597 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:36.592914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:36.594328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:36.594607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:36.594877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] PATH_INFO: `/v3/users/a76dbc21a9a14392bea441d48678a954` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:36.596221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76dbc21a9a14392bea441d48678a954)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:36.598288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:36.648284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:36.659522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76dbc21a9a14392bea441d48678a954'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:36.678812 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76dbc21a9a14392bea441d48678a954'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:36.679561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76dbc21a9a14392bea441d48678a954'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:36.689207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76dbc21a9a14392bea441d48678a954'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:36.699806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76dbc21a9a14392bea441d48678a954'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:36.708543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 934/1845] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:36 2022] DELETE /identity/v3/users/a76dbc21a9a14392bea441d48678a954 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:36.713903 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3879d-d879-402e-80a5-1b4a29bfdd5b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:36.713903 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3879d-d879-402e-80a5-1b4a29bfdd5b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:36.714298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3879d-d879-402e-80a5-1b4a29bfdd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:36.735535 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1dc3879d-d879-402e-80a5-1b4a29bfdd5b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:36.736996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1dc3879d-d879-402e-80a5-1b4a29bfdd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:36.791987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:36.817781 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 912/1846] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:36.848179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:36.849313 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:37.077836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f6844-3ae7-43fa-ba72-f0aaec91dbd3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:37.087372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc133fa-1a89-4b9f-bf0b-cd90afb827bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:37.088063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc133fa-1a89-4b9f-bf0b-cd90afb827bb service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:37.088348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc133fa-1a89-4b9f-bf0b-cd90afb827bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:37.088626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc133fa-1a89-4b9f-bf0b-cd90afb827bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:37.112718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc133fa-1a89-4b9f-bf0b-cd90afb827bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:37.114227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc133fa-1a89-4b9f-bf0b-cd90afb827bb service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:37.138375 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 935/1847] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:38.270346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3879d-d879-402e-80a5-1b4a29bfdd5b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:38.272671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1dc3879d-d879-402e-80a5-1b4a29bfdd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:38.302927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3879d-d879-402e-80a5-1b4a29bfdd5b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:38.318324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:38.320098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:38.320560 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:38.321101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] PATH_INFO: `/v3/projects/d59f290acd314d1f8cf935eb351bbec4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:38.323055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59f290acd314d1f8cf935eb351bbec4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:38.325907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:38.392720 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59f290acd314d1f8cf935eb351bbec4', 'request_id': 'req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.406880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59f290acd314d1f8cf935eb351bbec4', 'request_id': 'req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.419177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59f290acd314d1f8cf935eb351bbec4', 'request_id': 'req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.436627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] The token cache is being invalidate because project d59f290acd314d1f8cf935eb351bbec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:38.437305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.438014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.439656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 913/1848] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:38 2022] DELETE /identity/v3/projects/d59f290acd314d1f8cf935eb351bbec4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:38.443798 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc133fa-1a89-4b9f-bf0b-cd90afb827bb service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:38.453844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc133fa-1a89-4b9f-bf0b-cd90afb827bb service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:38.478105 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:38.479594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:38.521326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c2de5-c30e-4e32-a7c7-b4ad7e3b82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:38.522459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c2de5-c30e-4e32-a7c7-b4ad7e3b82a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:38.522805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c2de5-c30e-4e32-a7c7-b4ad7e3b82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:38.523153 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c2de5-c30e-4e32-a7c7-b4ad7e3b82a2 admin admin] PATH_INFO: `/v3/users/85d8a258c0bd48e88dfac2d3a14555f4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:38.524693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c2de5-c30e-4e32-a7c7-b4ad7e3b82a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d8a258c0bd48e88dfac2d3a14555f4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:38.527059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c2de5-c30e-4e32-a7c7-b4ad7e3b82a2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:38.564236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c30e35-d0c6-4df0-b459-d5ff5da7b65b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:38.569666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:38.570593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:38.570875 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:38.571148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] PATH_INFO: `/v3/users/de9c497dda044d2d9768b06b40921877` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:38.572819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9c497dda044d2d9768b06b40921877)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:38.574927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:38.591771 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b30c2de5-c30e-4e32-a7c7-b4ad7e3b82a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d8a258c0bd48e88dfac2d3a14555f4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.599865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:38.605293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b30c2de5-c30e-4e32-a7c7-b4ad7e3b82a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d8a258c0bd48e88dfac2d3a14555f4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.606147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b30c2de5-c30e-4e32-a7c7-b4ad7e3b82a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d8a258c0bd48e88dfac2d3a14555f4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.616865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b30c2de5-c30e-4e32-a7c7-b4ad7e3b82a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d8a258c0bd48e88dfac2d3a14555f4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.625768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b30c2de5-c30e-4e32-a7c7-b4ad7e3b82a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d8a258c0bd48e88dfac2d3a14555f4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.626114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9c497dda044d2d9768b06b40921877'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.632496 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 936/1849] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:38 2022] DELETE /identity/v3/users/85d8a258c0bd48e88dfac2d3a14555f4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:38.638483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9c497dda044d2d9768b06b40921877'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.639157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9c497dda044d2d9768b06b40921877'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.639756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9c497dda044d2d9768b06b40921877'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.648195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9c497dda044d2d9768b06b40921877'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:38.650610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:38.663422 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 914/1850] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:38 2022] DELETE /identity/v3/users/de9c497dda044d2d9768b06b40921877 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:38.668256 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6866fc1-4f3d-4363-a954-796318ba1137 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:38.668623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6866fc1-4f3d-4363-a954-796318ba1137 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:38.668923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6866fc1-4f3d-4363-a954-796318ba1137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:38.686880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e6866fc1-4f3d-4363-a954-796318ba1137 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:38.688109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6866fc1-4f3d-4363-a954-796318ba1137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:38.749517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 937/1851] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:38.761068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:38.762931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:38.830677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852d21d-1981-46c5-92c7-7533fabbda51 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:38.834717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7614a3-27c0-479a-850c-5eaf27c67909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:38.835444 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7614a3-27c0-479a-850c-5eaf27c67909 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:38.835766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7614a3-27c0-479a-850c-5eaf27c67909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:38.836039 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7614a3-27c0-479a-850c-5eaf27c67909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:38.846585 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7614a3-27c0-479a-850c-5eaf27c67909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:38.848071 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7614a3-27c0-479a-850c-5eaf27c67909 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:38.859625 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 915/1852] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:39.189102 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6866fc1-4f3d-4363-a954-796318ba1137 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:39.190863 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6866fc1-4f3d-4363-a954-796318ba1137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:39.215277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6866fc1-4f3d-4363-a954-796318ba1137 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:39.220907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:39.221940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.222269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.222601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] PATH_INFO: `/v3/projects/dcb0ffc75e32492ba629f999ab720a5a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:39.224113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb0ffc75e32492ba629f999ab720a5a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:39.226138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:39.274036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb0ffc75e32492ba629f999ab720a5a', 'request_id': 'req-f3dedaf5-0268-4ff9-8de0-667e603b788a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.282726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb0ffc75e32492ba629f999ab720a5a', 'request_id': 'req-f3dedaf5-0268-4ff9-8de0-667e603b788a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.289396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb0ffc75e32492ba629f999ab720a5a', 'request_id': 'req-f3dedaf5-0268-4ff9-8de0-667e603b788a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.301118 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] The token cache is being invalidate because project dcb0ffc75e32492ba629f999ab720a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:39.301347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.302129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.303723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 938/1853] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:39 2022] DELETE /identity/v3/projects/dcb0ffc75e32492ba629f999ab720a5a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:39.308755 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb636b-a5ea-4e8c-8c88-d2020110073a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.309286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb636b-a5ea-4e8c-8c88-d2020110073a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.309377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb636b-a5ea-4e8c-8c88-d2020110073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:39.328300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:39.329950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:39.335290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b3fb636b-a5ea-4e8c-8c88-d2020110073a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:39.336470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b3fb636b-a5ea-4e8c-8c88-d2020110073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:39.415837 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 916/1854] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:39.423325 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dedaf5-0268-4ff9-8de0-667e603b788a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:39.425318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138e099-6311-4294-9587-d138f0764f41 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.425604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138e099-6311-4294-9587-d138f0764f41 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.425876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138e099-6311-4294-9587-d138f0764f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:39.430527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:39.431797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.432174 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.432614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] PATH_INFO: `/v3/projects/289256172bdc4b9086ac55e7a477a75b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:39.436473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] RBAC: Authorizing `identity:delete_project(project_id=289256172bdc4b9086ac55e7a477a75b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:39.439616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:39.442806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:39.446648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3138e099-6311-4294-9587-d138f0764f41 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:39.448035 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3138e099-6311-4294-9587-d138f0764f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:39.456543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 917/1855] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:39.461831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138e099-6311-4294-9587-d138f0764f41 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:39.478874 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138e099-6311-4294-9587-d138f0764f41 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:39.483317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47051414-b135-4629-ad64-b677c486a7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:39.484118 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47051414-b135-4629-ad64-b677c486a7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.484419 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47051414-b135-4629-ad64-b677c486a7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.484749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47051414-b135-4629-ad64-b677c486a7c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:39.485590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47051414-b135-4629-ad64-b677c486a7c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:39.485900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47051414-b135-4629-ad64-b677c486a7c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:39.487521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47051414-b135-4629-ad64-b677c486a7c9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:39.500890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 918/1856] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:39.505266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47051414-b135-4629-ad64-b677c486a7c9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:39.507165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '289256172bdc4b9086ac55e7a477a75b', 'request_id': 'req-2bac58bb-6b88-49ee-85e6-f47ae79af26a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.516262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '289256172bdc4b9086ac55e7a477a75b', 'request_id': 'req-2bac58bb-6b88-49ee-85e6-f47ae79af26a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.517572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47051414-b135-4629-ad64-b677c486a7c9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:39.524332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '289256172bdc4b9086ac55e7a477a75b', 'request_id': 'req-2bac58bb-6b88-49ee-85e6-f47ae79af26a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.537955 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] The token cache is being invalidate because project 289256172bdc4b9086ac55e7a477a75b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:39.538291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.539140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.541110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 939/1857] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:39 2022] DELETE /identity/v3/projects/289256172bdc4b9086ac55e7a477a75b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:39.545040 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:39.546563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:39.591681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696568f-bdd7-4cce-b4d2-68f4c70e879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:39.592374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696568f-bdd7-4cce-b4d2-68f4c70e879b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.592718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696568f-bdd7-4cce-b4d2-68f4c70e879b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.593107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696568f-bdd7-4cce-b4d2-68f4c70e879b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:39.593981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696568f-bdd7-4cce-b4d2-68f4c70e879b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:39.595995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696568f-bdd7-4cce-b4d2-68f4c70e879b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:39.627950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:39.638563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac58bb-6b88-49ee-85e6-f47ae79af26a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:39.639369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 919/1858] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:39 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:39.641774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696568f-bdd7-4cce-b4d2-68f4c70e879b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:39.644229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1696568f-bdd7-4cce-b4d2-68f4c70e879b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:39.720522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:39.721838 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.722114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.722384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] PATH_INFO: `/v3/users/943e18d8ba2448dea65966496b53075e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:39.723645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] RBAC: Authorizing `identity:delete_user(user_id=943e18d8ba2448dea65966496b53075e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:39.725629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:39.727879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696568f-bdd7-4cce-b4d2-68f4c70e879b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:39.734442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcc3ab-57fb-48c2-933c-bacd9dae4493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:39.735521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc3ab-57fb-48c2-933c-bacd9dae4493 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.735521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc3ab-57fb-48c2-933c-bacd9dae4493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.735709 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc3ab-57fb-48c2-933c-bacd9dae4493 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:39.736342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcc3ab-57fb-48c2-933c-bacd9dae4493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:39.738730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcc3ab-57fb-48c2-933c-bacd9dae4493 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:39.774688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 920/1859] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:39 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:39.779246 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcc3ab-57fb-48c2-933c-bacd9dae4493 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:39.785561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:39.794607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcc3ab-57fb-48c2-933c-bacd9dae4493 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:39.800171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943e18d8ba2448dea65966496b53075e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.800934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad03511-74f3-4bcb-9554-935a3a83aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:39.801832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03511-74f3-4bcb-9554-935a3a83aad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.802317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03511-74f3-4bcb-9554-935a3a83aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.802724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03511-74f3-4bcb-9554-935a3a83aad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:39.804096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad03511-74f3-4bcb-9554-935a3a83aad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:39.806137 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad03511-74f3-4bcb-9554-935a3a83aad8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:39.819885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 921/1860] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:39.824090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad03511-74f3-4bcb-9554-935a3a83aad8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:39.826109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943e18d8ba2448dea65966496b53075e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.826884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943e18d8ba2448dea65966496b53075e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.836472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943e18d8ba2448dea65966496b53075e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.839211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad03511-74f3-4bcb-9554-935a3a83aad8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:39.844410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943e18d8ba2448dea65966496b53075e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:39.845198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6451f6-c7fb-468e-9d49-09d469a5ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:39.845888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6451f6-c7fb-468e-9d49-09d469a5ab5d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.846201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6451f6-c7fb-468e-9d49-09d469a5ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.846568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6451f6-c7fb-468e-9d49-09d469a5ab5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:39.847315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6451f6-c7fb-468e-9d49-09d469a5ab5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:39.849529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6451f6-c7fb-468e-9d49-09d469a5ab5d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:39.853041 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 940/1861] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:39 2022] DELETE /identity/v3/users/943e18d8ba2448dea65966496b53075e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:39.870096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 922/1862] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:39.871001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:39.872445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:39.943009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87cfae-e5bc-4f5f-a831-ecfc07fc601e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:39.947768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1974cf1-f404-4431-a7db-53d70579e1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:39.948670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1974cf1-f404-4431-a7db-53d70579e1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.948985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1974cf1-f404-4431-a7db-53d70579e1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.949255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1974cf1-f404-4431-a7db-53d70579e1e6 admin admin] PATH_INFO: `/v3/projects/7052f3bbf4ed4a9bb8dd4bddbc4794bb/users/ee02c33f219c424483217d4ee620950a/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:39.965388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1974cf1-f404-4431-a7db-53d70579e1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7052f3bbf4ed4a9bb8dd4bddbc4794bb, user_id=ee02c33f219c424483217d4ee620950a, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:39.968200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1974cf1-f404-4431-a7db-53d70579e1e6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:39.982690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 941/1863] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:39 2022] PUT /identity/v3/projects/7052f3bbf4ed4a9bb8dd4bddbc4794bb/users/ee02c33f219c424483217d4ee620950a/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:39.993604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7144-4cd3-4153-a212-6301dcee8c91 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:39.993910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7144-4cd3-4153-a212-6301dcee8c91 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:39.994184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7144-4cd3-4153-a212-6301dcee8c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.024836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b63f7144-4cd3-4153-a212-6301dcee8c91 None None] MFA Rules not processed for user `ee02c33f219c424483217d4ee620950a`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:40.026132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b63f7144-4cd3-4153-a212-6301dcee8c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:40.107125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 923/1864] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:40.111699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1974cf1-f404-4431-a7db-53d70579e1e6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.166700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f7144-4cd3-4153-a212-6301dcee8c91 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.168224 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b63f7144-4cd3-4153-a212-6301dcee8c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:40.194773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1974cf1-f404-4431-a7db-53d70579e1e6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.200842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ca0a1-b9fc-4a96-a627-0568a0902c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.201950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ca0a1-b9fc-4a96-a627-0568a0902c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.201950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ca0a1-b9fc-4a96-a627-0568a0902c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.202178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ca0a1-b9fc-4a96-a627-0568a0902c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.202848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ca0a1-b9fc-4a96-a627-0568a0902c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.204797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ca0a1-b9fc-4a96-a627-0568a0902c34 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.231609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 942/1865] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:40 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:40.237001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ca0a1-b9fc-4a96-a627-0568a0902c34 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.237557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:40.242247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f7144-4cd3-4153-a212-6301dcee8c91 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.264839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:40.299038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.299900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.300170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.300439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] PATH_INFO: `/v3/projects/1863358261474766818c7d0ac1f002ab` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.301650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1863358261474766818c7d0ac1f002ab)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.302895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ca0a1-b9fc-4a96-a627-0568a0902c34 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.303541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.307812 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcbd60-836b-4e4d-951d-6e570566a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.308483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcbd60-836b-4e4d-951d-6e570566a43f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.308763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcbd60-836b-4e4d-951d-6e570566a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.309073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcbd60-836b-4e4d-951d-6e570566a43f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.309766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcbd60-836b-4e4d-951d-6e570566a43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.311697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcbd60-836b-4e4d-951d-6e570566a43f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.335644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 943/1866] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:40 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:40.339673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcbd60-836b-4e4d-951d-6e570566a43f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.349346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1863358261474766818c7d0ac1f002ab', 'request_id': 'req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:40.349910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcbd60-836b-4e4d-951d-6e570566a43f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.358052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1863358261474766818c7d0ac1f002ab', 'request_id': 'req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:40.363656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1863358261474766818c7d0ac1f002ab', 'request_id': 'req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:40.375362 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] The token cache is being invalidate because project 1863358261474766818c7d0ac1f002ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:40.375648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:40.376288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f3069bf4-2b4c-4fec-9d47-ad7a11e33805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:40.377905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 924/1867] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:40 2022] DELETE /identity/v3/projects/1863358261474766818c7d0ac1f002ab => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:40.383604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106a7d-3e13-4cc4-9ff6-21a74bf2375c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.383975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106a7d-3e13-4cc4-9ff6-21a74bf2375c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.384248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106a7d-3e13-4cc4-9ff6-21a74bf2375c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.402875 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ce106a7d-3e13-4cc4-9ff6-21a74bf2375c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:40.403966 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce106a7d-3e13-4cc4-9ff6-21a74bf2375c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:40.413529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5218f-1b1e-4d49-b666-4c9cc6c08fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.414202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5218f-1b1e-4d49-b666-4c9cc6c08fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.414480 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5218f-1b1e-4d49-b666-4c9cc6c08fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.414755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5218f-1b1e-4d49-b666-4c9cc6c08fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.415517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5218f-1b1e-4d49-b666-4c9cc6c08fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.417153 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5218f-1b1e-4d49-b666-4c9cc6c08fd8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.431236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 944/1868] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:31:40.432334 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5218f-1b1e-4d49-b666-4c9cc6c08fd8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.434191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7cd5218f-1b1e-4d49-b666-4c9cc6c08fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:40.447908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5218f-1b1e-4d49-b666-4c9cc6c08fd8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.452853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91a6e-b815-4d40-af87-c3f8cf4319a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.453904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91a6e-b815-4d40-af87-c3f8cf4319a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.454186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91a6e-b815-4d40-af87-c3f8cf4319a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.454464 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91a6e-b815-4d40-af87-c3f8cf4319a5 admin admin] PATH_INFO: `/v3/projects/c6d567bdbec749f2bb508ef22c0784aa/users/a4f19efefd5a498fadcb7c6b59331240/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.462968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 925/1869] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:40.469197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e91a6e-b815-4d40-af87-c3f8cf4319a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d567bdbec749f2bb508ef22c0784aa, user_id=a4f19efefd5a498fadcb7c6b59331240, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.471321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e3610-0e58-4b14-9380-624744b96bbd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.471608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e3610-0e58-4b14-9380-624744b96bbd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.472167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e3610-0e58-4b14-9380-624744b96bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.472272 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e91a6e-b815-4d40-af87-c3f8cf4319a5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.488792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 945/1870] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:40 2022] PUT /identity/v3/projects/c6d567bdbec749f2bb508ef22c0784aa/users/a4f19efefd5a498fadcb7c6b59331240/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:40.492854 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b25e3610-0e58-4b14-9380-624744b96bbd None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:40.493342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91a6e-b815-4d40-af87-c3f8cf4319a5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.494083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b25e3610-0e58-4b14-9380-624744b96bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:40.527145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:40.557435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 926/1871] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:40.558067 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91a6e-b815-4d40-af87-c3f8cf4319a5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.561601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e3610-0e58-4b14-9380-624744b96bbd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.562740 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bdc11-309b-4a48-922a-abba03d7d217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.563408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bdc11-309b-4a48-922a-abba03d7d217 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.563684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bdc11-309b-4a48-922a-abba03d7d217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.563985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bdc11-309b-4a48-922a-abba03d7d217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.564704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bdc11-309b-4a48-922a-abba03d7d217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.566352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bdc11-309b-4a48-922a-abba03d7d217 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.570632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e3610-0e58-4b14-9380-624744b96bbd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.576519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee1f30-5818-4726-8ba4-0893fd0f90ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.577278 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1f30-5818-4726-8ba4-0893fd0f90ef admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.580569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 946/1872] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:40.581421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1f30-5818-4726-8ba4-0893fd0f90ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.581421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1f30-5818-4726-8ba4-0893fd0f90ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.581421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee1f30-5818-4726-8ba4-0893fd0f90ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:40.581421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee1f30-5818-4726-8ba4-0893fd0f90ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.581421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee1f30-5818-4726-8ba4-0893fd0f90ef admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.581940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bdc11-309b-4a48-922a-abba03d7d217 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.594182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bdc11-309b-4a48-922a-abba03d7d217 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.595024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 927/1873] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:31:40.600113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee1f30-5818-4726-8ba4-0893fd0f90ef admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.601359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d893ea-3d9e-4cb1-8876-d6908a5b8ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.602354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d893ea-3d9e-4cb1-8876-d6908a5b8ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.602776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d893ea-3d9e-4cb1-8876-d6908a5b8ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.603166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d893ea-3d9e-4cb1-8876-d6908a5b8ec6 admin admin] PATH_INFO: `/v3/projects/c6d567bdbec749f2bb508ef22c0784aa/users/a4f19efefd5a498fadcb7c6b59331240/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.617261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee1f30-5818-4726-8ba4-0893fd0f90ef admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.619893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d893ea-3d9e-4cb1-8876-d6908a5b8ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d567bdbec749f2bb508ef22c0784aa, user_id=a4f19efefd5a498fadcb7c6b59331240, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.624610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d893ea-3d9e-4cb1-8876-d6908a5b8ec6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.627939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00997ff8-a7c9-41f5-aa72-dab28e527b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.629599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00997ff8-a7c9-41f5-aa72-dab28e527b63 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.630054 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00997ff8-a7c9-41f5-aa72-dab28e527b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.630497 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00997ff8-a7c9-41f5-aa72-dab28e527b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.631741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00997ff8-a7c9-41f5-aa72-dab28e527b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.636090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00997ff8-a7c9-41f5-aa72-dab28e527b63 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.642559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 947/1874] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:40 2022] PUT /identity/v3/projects/c6d567bdbec749f2bb508ef22c0784aa/users/a4f19efefd5a498fadcb7c6b59331240/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:40.663360 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc741e-30f3-4eb2-88c0-62002936b481 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.664696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc741e-30f3-4eb2-88c0-62002936b481 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.665940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc741e-30f3-4eb2-88c0-62002936b481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.727925 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:40.728447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 928/1875] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:40 2022] POST /identity/v3/projects => generated 361 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:40.732253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00997ff8-a7c9-41f5-aa72-dab28e527b63 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.747232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1ddc741e-30f3-4eb2-88c0-62002936b481 None None] MFA Rules not processed for user `a4f19efefd5a498fadcb7c6b59331240`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:40.749969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1ddc741e-30f3-4eb2-88c0-62002936b481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:40.830833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00997ff8-a7c9-41f5-aa72-dab28e527b63 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.836359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a31d38-167f-4a3b-95c6-35a33cca1dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.837327 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31d38-167f-4a3b-95c6-35a33cca1dee admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.837708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31d38-167f-4a3b-95c6-35a33cca1dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.838078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31d38-167f-4a3b-95c6-35a33cca1dee admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.838893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a31d38-167f-4a3b-95c6-35a33cca1dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.844198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a31d38-167f-4a3b-95c6-35a33cca1dee admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.862751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 948/1876] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:40.871517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc741e-30f3-4eb2-88c0-62002936b481 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.876014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1ddc741e-30f3-4eb2-88c0-62002936b481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:40.876156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 929/1877] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:40 2022] POST /identity/v3/users => generated 281 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:40.877457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a31d38-167f-4a3b-95c6-35a33cca1dee admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.891995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a31d38-167f-4a3b-95c6-35a33cca1dee admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.898629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42458b49-0383-4417-8fc8-c6116a5b2d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.899742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42458b49-0383-4417-8fc8-c6116a5b2d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.900215 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42458b49-0383-4417-8fc8-c6116a5b2d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.900678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42458b49-0383-4417-8fc8-c6116a5b2d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.901694 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42458b49-0383-4417-8fc8-c6116a5b2d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.903817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42458b49-0383-4417-8fc8-c6116a5b2d4f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.918632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 930/1878] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:40.922391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42458b49-0383-4417-8fc8-c6116a5b2d4f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.932920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42458b49-0383-4417-8fc8-c6116a5b2d4f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.937745 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9eec60-0edf-4ad3-8fd4-4266bb75af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.938347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eec60-0edf-4ad3-8fd4-4266bb75af0d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.938629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eec60-0edf-4ad3-8fd4-4266bb75af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.939381 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eec60-0edf-4ad3-8fd4-4266bb75af0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.939662 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9eec60-0edf-4ad3-8fd4-4266bb75af0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.941313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9eec60-0edf-4ad3-8fd4-4266bb75af0d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.943207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc741e-30f3-4eb2-88c0-62002936b481 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.950278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cd200-2643-4984-8390-7d35e97b261b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.951024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd200-2643-4984-8390-7d35e97b261b service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.951396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd200-2643-4984-8390-7d35e97b261b service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.951733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd200-2643-4984-8390-7d35e97b261b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:40.953113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 931/1879] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:40.957058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9eec60-0edf-4ad3-8fd4-4266bb75af0d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:40.968637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9eec60-0edf-4ad3-8fd4-4266bb75af0d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:40.970052 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cd200-2643-4984-8390-7d35e97b261b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:40.972100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cd200-2643-4984-8390-7d35e97b261b service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:40.973894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff206d-7063-455c-b5b6-0a47868c9731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:40.975018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff206d-7063-455c-b5b6-0a47868c9731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:40.975363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff206d-7063-455c-b5b6-0a47868c9731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:40.975700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff206d-7063-455c-b5b6-0a47868c9731 admin admin] PATH_INFO: `/v3/projects/e7895a67d43d48cdbc26adfa21e25902/users/8714db540cb74cb5a356fb6fbf425ce6/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:41.001922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 949/1880] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:31:41.009111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff206d-7063-455c-b5b6-0a47868c9731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7895a67d43d48cdbc26adfa21e25902, user_id=8714db540cb74cb5a356fb6fbf425ce6, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:41.012816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff206d-7063-455c-b5b6-0a47868c9731 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:41.035297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 932/1881] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:40 2022] PUT /identity/v3/projects/e7895a67d43d48cdbc26adfa21e25902/users/8714db540cb74cb5a356fb6fbf425ce6/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:41.048800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78cb82-8f0a-4f96-8530-f9d3fab62e35 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:41.049320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78cb82-8f0a-4f96-8530-f9d3fab62e35 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:41.049661 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78cb82-8f0a-4f96-8530-f9d3fab62e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:41.066403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff206d-7063-455c-b5b6-0a47868c9731 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:41.108791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1f78cb82-8f0a-4f96-8530-f9d3fab62e35 None None] MFA Rules not processed for user `8714db540cb74cb5a356fb6fbf425ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:41.111163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f78cb82-8f0a-4f96-8530-f9d3fab62e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:41.154578 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:41.201349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff206d-7063-455c-b5b6-0a47868c9731 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:41.205945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 950/1882] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:41.226426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c6d92-695b-4dc6-b87d-ca21883530a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:41.227416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c6d92-695b-4dc6-b87d-ca21883530a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:41.227653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c6d92-695b-4dc6-b87d-ca21883530a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:41.232856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c6d92-695b-4dc6-b87d-ca21883530a1 admin admin] PATH_INFO: `/v3/users/ee02c33f219c424483217d4ee620950a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:41.243480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c6d92-695b-4dc6-b87d-ca21883530a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee02c33f219c424483217d4ee620950a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:41.246413 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c6d92-695b-4dc6-b87d-ca21883530a1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:41.248683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78cb82-8f0a-4f96-8530-f9d3fab62e35 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:41.250489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f78cb82-8f0a-4f96-8530-f9d3fab62e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:41.289173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:41.332058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78cb82-8f0a-4f96-8530-f9d3fab62e35 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:41.337183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d086ad8-16e7-4667-a026-81a76d809a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:41.338452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d086ad8-16e7-4667-a026-81a76d809a8f service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:41.338634 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d086ad8-16e7-4667-a026-81a76d809a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:41.338910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d086ad8-16e7-4667-a026-81a76d809a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:41.354536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d086ad8-16e7-4667-a026-81a76d809a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:41.357459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d086ad8-16e7-4667-a026-81a76d809a8f service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:41.369666 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 951/1883] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:41.384189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d086ad8-16e7-4667-a026-81a76d809a8f service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:41.389866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d73c6d92-695b-4dc6-b87d-ca21883530a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee02c33f219c424483217d4ee620950a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:41.404823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d086ad8-16e7-4667-a026-81a76d809a8f service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:41.412774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb731b-22c9-4df6-8494-2b861201343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:41.413932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb731b-22c9-4df6-8494-2b861201343d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:41.414213 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb731b-22c9-4df6-8494-2b861201343d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:41.414487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb731b-22c9-4df6-8494-2b861201343d admin admin] PATH_INFO: `/v3/users/8714db540cb74cb5a356fb6fbf425ce6` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:41.415835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb731b-22c9-4df6-8494-2b861201343d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8714db540cb74cb5a356fb6fbf425ce6)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:41.418088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb731b-22c9-4df6-8494-2b861201343d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:41.439257 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d73c6d92-695b-4dc6-b87d-ca21883530a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee02c33f219c424483217d4ee620950a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:41.440504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d73c6d92-695b-4dc6-b87d-ca21883530a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee02c33f219c424483217d4ee620950a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:41.441609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d73c6d92-695b-4dc6-b87d-ca21883530a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee02c33f219c424483217d4ee620950a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:41.456502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d73c6d92-695b-4dc6-b87d-ca21883530a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee02c33f219c424483217d4ee620950a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:41.478404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 933/1884] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:41 2022] DELETE /identity/v3/users/ee02c33f219c424483217d4ee620950a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:41.481028 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2cfb731b-22c9-4df6-8494-2b861201343d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8714db540cb74cb5a356fb6fbf425ce6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:41.482810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888f957-3220-4109-bd19-8d6743d80347 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:41.483104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888f957-3220-4109-bd19-8d6743d80347 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:41.483381 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888f957-3220-4109-bd19-8d6743d80347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:41.497992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2cfb731b-22c9-4df6-8494-2b861201343d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8714db540cb74cb5a356fb6fbf425ce6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:41.499024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2cfb731b-22c9-4df6-8494-2b861201343d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8714db540cb74cb5a356fb6fbf425ce6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:41.503520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7888f957-3220-4109-bd19-8d6743d80347 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:41.504808 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7888f957-3220-4109-bd19-8d6743d80347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:41.509212 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2cfb731b-22c9-4df6-8494-2b861201343d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8714db540cb74cb5a356fb6fbf425ce6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:41.519621 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2cfb731b-22c9-4df6-8494-2b861201343d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8714db540cb74cb5a356fb6fbf425ce6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:41.535474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 952/1885] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:41 2022] DELETE /identity/v3/users/8714db540cb74cb5a356fb6fbf425ce6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:41.539646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85df73-6e25-42c3-854b-528f0781bd08 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:41.540192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85df73-6e25-42c3-854b-528f0781bd08 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:41.540581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85df73-6e25-42c3-854b-528f0781bd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:41.558308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cf85df73-6e25-42c3-854b-528f0781bd08 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:41.559502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cf85df73-6e25-42c3-854b-528f0781bd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:41.601683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 934/1886] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:41.612249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888f957-3220-4109-bd19-8d6743d80347 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:41.613971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7888f957-3220-4109-bd19-8d6743d80347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:41.656656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 953/1887] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:41.668894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85df73-6e25-42c3-854b-528f0781bd08 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:41.671484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cf85df73-6e25-42c3-854b-528f0781bd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:41.701509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888f957-3220-4109-bd19-8d6743d80347 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:41.735922 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:41.759508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:41.778494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a30b3-3945-4b3d-8b0f-3e301fb18801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:41.779218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a30b3-3945-4b3d-8b0f-3e301fb18801 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:41.779671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a30b3-3945-4b3d-8b0f-3e301fb18801 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:41.779985 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a30b3-3945-4b3d-8b0f-3e301fb18801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:41.791862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85df73-6e25-42c3-854b-528f0781bd08 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:41.793292 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a30b3-3945-4b3d-8b0f-3e301fb18801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:41.796541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a30b3-3945-4b3d-8b0f-3e301fb18801 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:41.797395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44f625-585e-41a8-b94f-66ea0b0dbbe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:41.798186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44f625-585e-41a8-b94f-66ea0b0dbbe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:41.800333 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44f625-585e-41a8-b94f-66ea0b0dbbe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:41.800726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44f625-585e-41a8-b94f-66ea0b0dbbe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:41.808554 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 935/1888] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:31:41.820489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44f625-585e-41a8-b94f-66ea0b0dbbe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:41.822329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44f625-585e-41a8-b94f-66ea0b0dbbe5 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:41.835597 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 954/1889] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:43.495440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a30b3-3945-4b3d-8b0f-3e301fb18801 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:43.497661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-719a30b3-3945-4b3d-8b0f-3e301fb18801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:43.519299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a30b3-3945-4b3d-8b0f-3e301fb18801 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:43.527811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:43.529122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:43.529502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:43.529811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] PATH_INFO: `/v3/projects/7052f3bbf4ed4a9bb8dd4bddbc4794bb` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:43.532315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7052f3bbf4ed4a9bb8dd4bddbc4794bb)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:43.535307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:43.563573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44f625-585e-41a8-b94f-66ea0b0dbbe5 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:43.566019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dd44f625-585e-41a8-b94f-66ea0b0dbbe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:43.579499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44f625-585e-41a8-b94f-66ea0b0dbbe5 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:43.590743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7052f3bbf4ed4a9bb8dd4bddbc4794bb', 'request_id': 'req-e733a4b9-bece-4037-83e9-1ecf910cfb79'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.601405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7052f3bbf4ed4a9bb8dd4bddbc4794bb', 'request_id': 'req-e733a4b9-bece-4037-83e9-1ecf910cfb79'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.607659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7052f3bbf4ed4a9bb8dd4bddbc4794bb', 'request_id': 'req-e733a4b9-bece-4037-83e9-1ecf910cfb79'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.623443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] The token cache is being invalidate because project 7052f3bbf4ed4a9bb8dd4bddbc4794bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:43.623828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.624705 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.628097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 936/1890] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:43 2022] DELETE /identity/v3/projects/7052f3bbf4ed4a9bb8dd4bddbc4794bb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:43.646021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:43.646139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:43.647080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:43.647443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:43.647748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:43.647956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] PATH_INFO: `/v3/projects/e7895a67d43d48cdbc26adfa21e25902` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:43.649415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7895a67d43d48cdbc26adfa21e25902)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:43.651404 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:43.672120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733a4b9-bece-4037-83e9-1ecf910cfb79 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:43.679241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a96444-6e5e-48ac-8c6d-65c65548d6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:43.680141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a96444-6e5e-48ac-8c6d-65c65548d6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:43.680445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a96444-6e5e-48ac-8c6d-65c65548d6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:43.680728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a96444-6e5e-48ac-8c6d-65c65548d6ce admin admin] PATH_INFO: `/v3/users/a4f19efefd5a498fadcb7c6b59331240` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:43.681999 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a96444-6e5e-48ac-8c6d-65c65548d6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f19efefd5a498fadcb7c6b59331240)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:43.683990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a96444-6e5e-48ac-8c6d-65c65548d6ce admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:43.714608 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7895a67d43d48cdbc26adfa21e25902', 'request_id': 'req-d5b09ceb-7aa1-4858-ba11-f302a79865fc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.740260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7895a67d43d48cdbc26adfa21e25902', 'request_id': 'req-d5b09ceb-7aa1-4858-ba11-f302a79865fc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.744283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-03a96444-6e5e-48ac-8c6d-65c65548d6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f19efefd5a498fadcb7c6b59331240'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.749140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7895a67d43d48cdbc26adfa21e25902', 'request_id': 'req-d5b09ceb-7aa1-4858-ba11-f302a79865fc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.764203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] The token cache is being invalidate because project e7895a67d43d48cdbc26adfa21e25902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:43.764638 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.765138 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-03a96444-6e5e-48ac-8c6d-65c65548d6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f19efefd5a498fadcb7c6b59331240'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.765928 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-03a96444-6e5e-48ac-8c6d-65c65548d6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f19efefd5a498fadcb7c6b59331240'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.767411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-03a96444-6e5e-48ac-8c6d-65c65548d6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f19efefd5a498fadcb7c6b59331240'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.770489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d5b09ceb-7aa1-4858-ba11-f302a79865fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.772999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 955/1891] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:43 2022] DELETE /identity/v3/projects/e7895a67d43d48cdbc26adfa21e25902 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:43.781317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deecf58-da20-4768-9657-5d02c12653ef None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:43.782704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deecf58-da20-4768-9657-5d02c12653ef None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:43.783209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deecf58-da20-4768-9657-5d02c12653ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:43.789378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-03a96444-6e5e-48ac-8c6d-65c65548d6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f19efefd5a498fadcb7c6b59331240'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:43.820430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 937/1892] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:43 2022] DELETE /identity/v3/users/a4f19efefd5a498fadcb7c6b59331240 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:43.825261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2deecf58-da20-4768-9657-5d02c12653ef None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:43.826880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2deecf58-da20-4768-9657-5d02c12653ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:43.929062 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 956/1893] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:43.937714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35293-4fa6-4f47-8604-137b013220f2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:43.938069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35293-4fa6-4f47-8604-137b013220f2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:43.938406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35293-4fa6-4f47-8604-137b013220f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:43.957384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-62f35293-4fa6-4f47-8604-137b013220f2 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:43.958428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-62f35293-4fa6-4f47-8604-137b013220f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:43.966882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 938/1894] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:43.971208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deecf58-da20-4768-9657-5d02c12653ef None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:43.984009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deecf58-da20-4768-9657-5d02c12653ef None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:43.990329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa5d2d-a0d0-497b-8ae8-fbe2060aec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:43.991186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5d2d-a0d0-497b-8ae8-fbe2060aec64 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:43.991477 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5d2d-a0d0-497b-8ae8-fbe2060aec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:43.991760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5d2d-a0d0-497b-8ae8-fbe2060aec64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:43.992520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa5d2d-a0d0-497b-8ae8-fbe2060aec64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:43.992837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa5d2d-a0d0-497b-8ae8-fbe2060aec64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:43.994568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa5d2d-a0d0-497b-8ae8-fbe2060aec64 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.016903 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 957/1895] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:31:44.017925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35293-4fa6-4f47-8604-137b013220f2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.028658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35293-4fa6-4f47-8604-137b013220f2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.033706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af93fe1-fe3a-4aa8-a4dd-ac2e257abc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.034372 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af93fe1-fe3a-4aa8-a4dd-ac2e257abc03 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.034761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af93fe1-fe3a-4aa8-a4dd-ac2e257abc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.035036 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af93fe1-fe3a-4aa8-a4dd-ac2e257abc03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.035779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af93fe1-fe3a-4aa8-a4dd-ac2e257abc03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.037740 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af93fe1-fe3a-4aa8-a4dd-ac2e257abc03 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.048312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:44.073960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 939/1896] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:44 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:44.078891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa5d2d-a0d0-497b-8ae8-fbe2060aec64 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.085276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:44.092090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa5d2d-a0d0-497b-8ae8-fbe2060aec64 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.159791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a9aba-b064-4847-97e1-80733e295657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.160473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a9aba-b064-4847-97e1-80733e295657 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.160778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a9aba-b064-4847-97e1-80733e295657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.161096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a9aba-b064-4847-97e1-80733e295657 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.161804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a9aba-b064-4847-97e1-80733e295657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.165521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a9aba-b064-4847-97e1-80733e295657 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.187447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 958/1897] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:44 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:44.191603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af93fe1-fe3a-4aa8-a4dd-ac2e257abc03 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.202350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af93fe1-fe3a-4aa8-a4dd-ac2e257abc03 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.207325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240dbe9-fd31-4d84-972d-a15d75c77ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.207814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240dbe9-fd31-4d84-972d-a15d75c77ece admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.208084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240dbe9-fd31-4d84-972d-a15d75c77ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.208684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240dbe9-fd31-4d84-972d-a15d75c77ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.209145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240dbe9-fd31-4d84-972d-a15d75c77ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.210774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240dbe9-fd31-4d84-972d-a15d75c77ece admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.222431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 940/1898] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:44.225451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a9aba-b064-4847-97e1-80733e295657 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.235499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a9aba-b064-4847-97e1-80733e295657 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.240511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e368e-f148-493a-8309-c299ac07c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.243268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e368e-f148-493a-8309-c299ac07c00d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.243268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e368e-f148-493a-8309-c299ac07c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.243268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e368e-f148-493a-8309-c299ac07c00d admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.243268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e368e-f148-493a-8309-c299ac07c00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.244421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e368e-f148-493a-8309-c299ac07c00d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.255976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 959/1899] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:44.260317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240dbe9-fd31-4d84-972d-a15d75c77ece admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.263010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e368e-f148-493a-8309-c299ac07c00d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.264651 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d50e368e-f148-493a-8309-c299ac07c00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:44.271067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240dbe9-fd31-4d84-972d-a15d75c77ece admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.276600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e6199-e038-437b-926a-fa391ffc37d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.277634 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e6199-e038-437b-926a-fa391ffc37d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.277956 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e6199-e038-437b-926a-fa391ffc37d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.278371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e6199-e038-437b-926a-fa391ffc37d6 admin admin] PATH_INFO: `/v3/projects/30f3c74b2dd74a8caa8a6dcab8823493/users/5da7c48c518e4024b7e3f52c132f5918/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.284776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e368e-f148-493a-8309-c299ac07c00d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.290487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.292078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.292330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.292670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] PATH_INFO: `/v3/projects/c6d567bdbec749f2bb508ef22c0784aa` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.293777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d567bdbec749f2bb508ef22c0784aa)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.296307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e6199-e038-437b-926a-fa391ffc37d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f3c74b2dd74a8caa8a6dcab8823493, user_id=5da7c48c518e4024b7e3f52c132f5918, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.298091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.299363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e6199-e038-437b-926a-fa391ffc37d6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.317226 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 941/1900] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:44 2022] PUT /identity/v3/projects/30f3c74b2dd74a8caa8a6dcab8823493/users/5da7c48c518e4024b7e3f52c132f5918/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:44.326899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4f7b1-f56e-472d-93cc-53bf9f1967d7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.327184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4f7b1-f56e-472d-93cc-53bf9f1967d7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.327452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4f7b1-f56e-472d-93cc-53bf9f1967d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.361606 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cba4f7b1-f56e-472d-93cc-53bf9f1967d7 None None] MFA Rules not processed for user `5da7c48c518e4024b7e3f52c132f5918`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:44.362951 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cba4f7b1-f56e-472d-93cc-53bf9f1967d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:44.376771 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d567bdbec749f2bb508ef22c0784aa', 'request_id': 'req-4c6d730e-d7db-4946-8ed1-355d625d38ea'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:44.392038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d567bdbec749f2bb508ef22c0784aa', 'request_id': 'req-4c6d730e-d7db-4946-8ed1-355d625d38ea'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:44.421006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d567bdbec749f2bb508ef22c0784aa', 'request_id': 'req-4c6d730e-d7db-4946-8ed1-355d625d38ea'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:44.443468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] The token cache is being invalidate because project c6d567bdbec749f2bb508ef22c0784aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:44.443870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:44.444684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4c6d730e-d7db-4946-8ed1-355d625d38ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:44.450302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 960/1901] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:44 2022] DELETE /identity/v3/projects/c6d567bdbec749f2bb508ef22c0784aa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:44.451858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1387-9100-415d-ae38-3d6d93633086 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.452255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1387-9100-415d-ae38-3d6d93633086 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.452662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1387-9100-415d-ae38-3d6d93633086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.468981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 942/1902] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:44.477480 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f57c1387-9100-415d-ae38-3d6d93633086 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:44.479652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f57c1387-9100-415d-ae38-3d6d93633086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:44.481853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4f7b1-f56e-472d-93cc-53bf9f1967d7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.485420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cba4f7b1-f56e-472d-93cc-53bf9f1967d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:44.558000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 961/1903] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:44.566424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef1303-c855-4e94-8f3e-718658014cb2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.567051 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef1303-c855-4e94-8f3e-718658014cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.567202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef1303-c855-4e94-8f3e-718658014cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.595462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:44.597119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-34ef1303-c855-4e94-8f3e-718658014cb2 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:44.598661 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-34ef1303-c855-4e94-8f3e-718658014cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:44.618392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 962/1904] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:44.624197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef1303-c855-4e94-8f3e-718658014cb2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.628647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4f7b1-f56e-472d-93cc-53bf9f1967d7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.632700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def1c73-40cf-45ff-a6a9-c98f5c3b759f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.633400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def1c73-40cf-45ff-a6a9-c98f5c3b759f service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.633795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def1c73-40cf-45ff-a6a9-c98f5c3b759f service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.634615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def1c73-40cf-45ff-a6a9-c98f5c3b759f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.636951 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8def1c73-40cf-45ff-a6a9-c98f5c3b759f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:44.638625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef1303-c855-4e94-8f3e-718658014cb2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.643689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9bfaf-cc2a-4432-ace6-db8de017bae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.644366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9bfaf-cc2a-4432-ace6-db8de017bae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.644646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9bfaf-cc2a-4432-ace6-db8de017bae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.645270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9bfaf-cc2a-4432-ace6-db8de017bae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.646028 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9bfaf-cc2a-4432-ace6-db8de017bae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:44.646474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9bfaf-cc2a-4432-ace6-db8de017bae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.648805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9bfaf-cc2a-4432-ace6-db8de017bae0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.668860 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 963/1905] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:31:44.673005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9bfaf-cc2a-4432-ace6-db8de017bae0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.680465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def1c73-40cf-45ff-a6a9-c98f5c3b759f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.683061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def1c73-40cf-45ff-a6a9-c98f5c3b759f service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.690987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9bfaf-cc2a-4432-ace6-db8de017bae0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.698365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea473af7-a7aa-46d7-b4d4-5cc84a113824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.699591 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea473af7-a7aa-46d7-b4d4-5cc84a113824 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.699881 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea473af7-a7aa-46d7-b4d4-5cc84a113824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.700235 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea473af7-a7aa-46d7-b4d4-5cc84a113824 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.701777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea473af7-a7aa-46d7-b4d4-5cc84a113824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.704020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea473af7-a7aa-46d7-b4d4-5cc84a113824 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.705744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 943/1906] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:44.777365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 964/1907] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:44 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:44.778599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def1c73-40cf-45ff-a6a9-c98f5c3b759f service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.795655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def1c73-40cf-45ff-a6a9-c98f5c3b759f service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.865782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:44.881856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e5702-7dd4-4bcb-9c62-459278c4efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.882702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e5702-7dd4-4bcb-9c62-459278c4efe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.883183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e5702-7dd4-4bcb-9c62-459278c4efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.883550 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e5702-7dd4-4bcb-9c62-459278c4efe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.884337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e5702-7dd4-4bcb-9c62-459278c4efe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.886376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e5702-7dd4-4bcb-9c62-459278c4efe6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.910254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 944/1908] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:44 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:44.915326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea473af7-a7aa-46d7-b4d4-5cc84a113824 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.928247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea473af7-a7aa-46d7-b4d4-5cc84a113824 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.935084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cc83d-806d-4095-9101-4561b206eb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.936331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cc83d-806d-4095-9101-4561b206eb48 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.936331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cc83d-806d-4095-9101-4561b206eb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.936526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cc83d-806d-4095-9101-4561b206eb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.937388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cc83d-806d-4095-9101-4561b206eb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.939175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cc83d-806d-4095-9101-4561b206eb48 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:44.954588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 965/1909] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:44.958481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e5702-7dd4-4bcb-9c62-459278c4efe6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:44.970818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e5702-7dd4-4bcb-9c62-459278c4efe6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:44.987753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9556ec-d1b9-4eae-95f1-fcd54cdf5545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:44.988452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9556ec-d1b9-4eae-95f1-fcd54cdf5545 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:44.988727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9556ec-d1b9-4eae-95f1-fcd54cdf5545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:44.989038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9556ec-d1b9-4eae-95f1-fcd54cdf5545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:44.990330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9556ec-d1b9-4eae-95f1-fcd54cdf5545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:44.992581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9556ec-d1b9-4eae-95f1-fcd54cdf5545 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:45.008993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 945/1910] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:45.010878 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cc83d-806d-4095-9101-4561b206eb48 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:45.028106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149640f-e183-40a6-b07f-b8cb24fab0f9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.028741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149640f-e183-40a6-b07f-b8cb24fab0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.029169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149640f-e183-40a6-b07f-b8cb24fab0f9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.031273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 946/1911] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:31:45.040426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cc83d-806d-4095-9101-4561b206eb48 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:45.048433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49461c-434b-4789-a928-c4b3ff81de85 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.048852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49461c-434b-4789-a928-c4b3ff81de85 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.053867 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49461c-434b-4789-a928-c4b3ff81de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.054127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b52d3-f127-4cf8-a385-4fa205304af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:45.055130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b52d3-f127-4cf8-a385-4fa205304af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.055445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b52d3-f127-4cf8-a385-4fa205304af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.055724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b52d3-f127-4cf8-a385-4fa205304af5 admin admin] PATH_INFO: `/v3/projects/9308a76f32bb415e95e7bb8bdae6be87/users/72be9cf57e3d4ca28362d1cf923cbd90/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.073143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b52d3-f127-4cf8-a385-4fa205304af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9308a76f32bb415e95e7bb8bdae6be87, user_id=72be9cf57e3d4ca28362d1cf923cbd90, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:45.076917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b52d3-f127-4cf8-a385-4fa205304af5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:45.111917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 966/1912] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:45 2022] PUT /identity/v3/projects/9308a76f32bb415e95e7bb8bdae6be87/users/72be9cf57e3d4ca28362d1cf923cbd90/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:45.114585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b7471-af94-4073-aeb8-da125b7aefd1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.114918 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b7471-af94-4073-aeb8-da125b7aefd1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.115247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b7471-af94-4073-aeb8-da125b7aefd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.142461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8e49461c-434b-4789-a928-c4b3ff81de85 None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:45.147163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8e49461c-434b-4789-a928-c4b3ff81de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:45.222726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-814b7471-af94-4073-aeb8-da125b7aefd1 None None] MFA Rules not processed for user `72be9cf57e3d4ca28362d1cf923cbd90`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:45.227699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-814b7471-af94-4073-aeb8-da125b7aefd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:45.299807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 947/1913] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:31:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:45.326976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 967/1914] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:45.332381 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49461c-434b-4789-a928-c4b3ff81de85 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:45.404184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49461c-434b-4789-a928-c4b3ff81de85 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:45.409085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8859a-57e6-467a-8edf-82af80b71882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:45.410043 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8859a-57e6-467a-8edf-82af80b71882 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.410419 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8859a-57e6-467a-8edf-82af80b71882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.410790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8859a-57e6-467a-8edf-82af80b71882 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.417341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8859a-57e6-467a-8edf-82af80b71882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:45.417341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8859a-57e6-467a-8edf-82af80b71882 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:45.418328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b7471-af94-4073-aeb8-da125b7aefd1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:45.420006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-814b7471-af94-4073-aeb8-da125b7aefd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:45.437301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b7471-af94-4073-aeb8-da125b7aefd1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:45.443138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d9f25-d58f-4392-bbe6-0e11de7e9edb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:45.443804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9f25-d58f-4392-bbe6-0e11de7e9edb service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.444089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9f25-d58f-4392-bbe6-0e11de7e9edb service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.444370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9f25-d58f-4392-bbe6-0e11de7e9edb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.448992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 948/1915] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:45 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:45.449912 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8859a-57e6-467a-8edf-82af80b71882 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:45.453907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d9f25-d58f-4392-bbe6-0e11de7e9edb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:45.455556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d9f25-d58f-4392-bbe6-0e11de7e9edb service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:45.466182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 968/1916] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:45.503481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:45.522729 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8859a-57e6-467a-8edf-82af80b71882 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:45.527412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a964008-b40a-47d1-ab41-8c6cb094de04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:45.528147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a964008-b40a-47d1-ab41-8c6cb094de04 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.528435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a964008-b40a-47d1-ab41-8c6cb094de04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.528708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a964008-b40a-47d1-ab41-8c6cb094de04 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.529505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a964008-b40a-47d1-ab41-8c6cb094de04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:45.531444 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a964008-b40a-47d1-ab41-8c6cb094de04 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:45.552978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 949/1917] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:45 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:45.557268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d9f25-d58f-4392-bbe6-0e11de7e9edb service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:45.567814 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d9f25-d58f-4392-bbe6-0e11de7e9edb service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:45.573258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879fa89-a1ba-4aed-a208-0ced432c6f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:45.573934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879fa89-a1ba-4aed-a208-0ced432c6f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.574280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879fa89-a1ba-4aed-a208-0ced432c6f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.574555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879fa89-a1ba-4aed-a208-0ced432c6f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.575314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879fa89-a1ba-4aed-a208-0ced432c6f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:45.577041 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879fa89-a1ba-4aed-a208-0ced432c6f06 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:45.588796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 969/1918] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:45.594931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a964008-b40a-47d1-ab41-8c6cb094de04 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:45.614075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a964008-b40a-47d1-ab41-8c6cb094de04 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:45.627846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879fa89-a1ba-4aed-a208-0ced432c6f06 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:45.629802 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a879fa89-a1ba-4aed-a208-0ced432c6f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:45.630496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374da4d-179f-4f3c-a564-df0e772e6975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:45.631352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374da4d-179f-4f3c-a564-df0e772e6975 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.631640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374da4d-179f-4f3c-a564-df0e772e6975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.631943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374da4d-179f-4f3c-a564-df0e772e6975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.632669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374da4d-179f-4f3c-a564-df0e772e6975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:45.634331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374da4d-179f-4f3c-a564-df0e772e6975 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:45.648555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879fa89-a1ba-4aed-a208-0ced432c6f06 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:45.649826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 950/1919] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:45.653943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374da4d-179f-4f3c-a564-df0e772e6975 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:45.656340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cbc2f-8b5d-4531-af28-bbd7f0075db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:45.657271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cbc2f-8b5d-4531-af28-bbd7f0075db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.657556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cbc2f-8b5d-4531-af28-bbd7f0075db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.657836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cbc2f-8b5d-4531-af28-bbd7f0075db4 admin admin] PATH_INFO: `/v3/users/84ae7d2552354c9b9b5ca55933e48fa5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.659064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cbc2f-8b5d-4531-af28-bbd7f0075db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ae7d2552354c9b9b5ca55933e48fa5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:45.661228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cbc2f-8b5d-4531-af28-bbd7f0075db4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:45.665968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374da4d-179f-4f3c-a564-df0e772e6975 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:45.671804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352da778-81ad-4caa-887b-0cb6ab17cf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:45.672975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352da778-81ad-4caa-887b-0cb6ab17cf1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.673330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352da778-81ad-4caa-887b-0cb6ab17cf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.673670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352da778-81ad-4caa-887b-0cb6ab17cf1a admin admin] PATH_INFO: `/v3/projects/66d3057ca7b04f25ba8a5b0347a8d15e/users/6ee4eef6f60c4fa4bf8ff4b3f6ecc28c/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.690429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352da778-81ad-4caa-887b-0cb6ab17cf1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d3057ca7b04f25ba8a5b0347a8d15e, user_id=6ee4eef6f60c4fa4bf8ff4b3f6ecc28c, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:45.693577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352da778-81ad-4caa-887b-0cb6ab17cf1a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:45.709143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 951/1920] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:45 2022] PUT /identity/v3/projects/66d3057ca7b04f25ba8a5b0347a8d15e/users/6ee4eef6f60c4fa4bf8ff4b3f6ecc28c/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:45.720017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-978cbc2f-8b5d-4531-af28-bbd7f0075db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ae7d2552354c9b9b5ca55933e48fa5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:45.720703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2675b-551a-403d-bc4a-6fc3d8cce7ee None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.721015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2675b-551a-403d-bc4a-6fc3d8cce7ee None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.721291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2675b-551a-403d-bc4a-6fc3d8cce7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.721388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:45.742180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-978cbc2f-8b5d-4531-af28-bbd7f0075db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ae7d2552354c9b9b5ca55933e48fa5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:45.745815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-978cbc2f-8b5d-4531-af28-bbd7f0075db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ae7d2552354c9b9b5ca55933e48fa5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:45.757067 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-978cbc2f-8b5d-4531-af28-bbd7f0075db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ae7d2552354c9b9b5ca55933e48fa5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:45.761246 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5af2675b-551a-403d-bc4a-6fc3d8cce7ee None None] MFA Rules not processed for user `6ee4eef6f60c4fa4bf8ff4b3f6ecc28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:45.762494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5af2675b-551a-403d-bc4a-6fc3d8cce7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:45.765949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-978cbc2f-8b5d-4531-af28-bbd7f0075db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ae7d2552354c9b9b5ca55933e48fa5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:45.772290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 970/1921] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:45 2022] DELETE /identity/v3/users/84ae7d2552354c9b9b5ca55933e48fa5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:45.776815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2777fb6-e0fd-4a0c-8682-1d2ea6e25696 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.777040 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2777fb6-e0fd-4a0c-8682-1d2ea6e25696 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.777302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2777fb6-e0fd-4a0c-8682-1d2ea6e25696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.793811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c2777fb6-e0fd-4a0c-8682-1d2ea6e25696 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:45.795013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c2777fb6-e0fd-4a0c-8682-1d2ea6e25696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:45.843066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 952/1922] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:45.847343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2675b-551a-403d-bc4a-6fc3d8cce7ee None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:45.848698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5af2675b-551a-403d-bc4a-6fc3d8cce7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:45.860276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 971/1923] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:45.874183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2777fb6-e0fd-4a0c-8682-1d2ea6e25696 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:45.875681 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c2777fb6-e0fd-4a0c-8682-1d2ea6e25696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:45.923614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2675b-551a-403d-bc4a-6fc3d8cce7ee None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:45.928144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e3b18-5189-40c5-8cb2-a793f45a091a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:45.928826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e3b18-5189-40c5-8cb2-a793f45a091a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.929135 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e3b18-5189-40c5-8cb2-a793f45a091a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.929409 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e3b18-5189-40c5-8cb2-a793f45a091a admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.930124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e3b18-5189-40c5-8cb2-a793f45a091a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:45.932067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e3b18-5189-40c5-8cb2-a793f45a091a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:45.933765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2777fb6-e0fd-4a0c-8682-1d2ea6e25696 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:45.937678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b3dc6-1bff-4466-9b54-2aaf32bdf0f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:45.938889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b3dc6-1bff-4466-9b54-2aaf32bdf0f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:45.938889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b3dc6-1bff-4466-9b54-2aaf32bdf0f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:45.939105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b3dc6-1bff-4466-9b54-2aaf32bdf0f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:45.949299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b3dc6-1bff-4466-9b54-2aaf32bdf0f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:45.951014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b3dc6-1bff-4466-9b54-2aaf32bdf0f5 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:45.961924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 953/1924] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:45 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:45.962676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 972/1925] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:45.966221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e3b18-5189-40c5-8cb2-a793f45a091a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:45.989972 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:46.048056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e3b18-5189-40c5-8cb2-a793f45a091a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.053098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693a05b-0b95-4d5b-b5ba-f79cd02fdacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.053827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693a05b-0b95-4d5b-b5ba-f79cd02fdacb admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.054108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693a05b-0b95-4d5b-b5ba-f79cd02fdacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.054379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693a05b-0b95-4d5b-b5ba-f79cd02fdacb admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.055120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693a05b-0b95-4d5b-b5ba-f79cd02fdacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:46.057141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693a05b-0b95-4d5b-b5ba-f79cd02fdacb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:46.080647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 954/1926] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:45 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:46.081995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b3dc6-1bff-4466-9b54-2aaf32bdf0f5 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:46.092050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b3dc6-1bff-4466-9b54-2aaf32bdf0f5 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.097373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53625e-7a14-4aab-8f40-514139043ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.098066 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53625e-7a14-4aab-8f40-514139043ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.098337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53625e-7a14-4aab-8f40-514139043ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.098611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53625e-7a14-4aab-8f40-514139043ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.099356 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53625e-7a14-4aab-8f40-514139043ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:46.100980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53625e-7a14-4aab-8f40-514139043ff9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:46.116180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 973/1927] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:46.117424 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693a05b-0b95-4d5b-b5ba-f79cd02fdacb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:46.128106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693a05b-0b95-4d5b-b5ba-f79cd02fdacb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.133062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6031ed-9b54-49fb-84fe-cd1b252abb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.134051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6031ed-9b54-49fb-84fe-cd1b252abb66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.134323 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6031ed-9b54-49fb-84fe-cd1b252abb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.134590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6031ed-9b54-49fb-84fe-cd1b252abb66 admin admin] PATH_INFO: `/v3/projects/5ce6e94b122b4290878cad533e85b1bc/users/01747becdac84355b671116fa3f26d27/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.151539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6031ed-9b54-49fb-84fe-cd1b252abb66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce6e94b122b4290878cad533e85b1bc, user_id=01747becdac84355b671116fa3f26d27, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:46.154272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6031ed-9b54-49fb-84fe-cd1b252abb66 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:46.169672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 955/1928] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:46 2022] PUT /identity/v3/projects/5ce6e94b122b4290878cad533e85b1bc/users/01747becdac84355b671116fa3f26d27/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:46.173947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53625e-7a14-4aab-8f40-514139043ff9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:46.186054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53625e-7a14-4aab-8f40-514139043ff9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.247720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:46.256348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98902-a4fc-47f5-a874-078561894922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.256971 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98902-a4fc-47f5-a874-078561894922 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.257626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98902-a4fc-47f5-a874-078561894922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.258150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98902-a4fc-47f5-a874-078561894922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.259676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d98902-a4fc-47f5-a874-078561894922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:46.260789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d98902-a4fc-47f5-a874-078561894922 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:46.278966 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 974/1929] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:31:46.280242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6031ed-9b54-49fb-84fe-cd1b252abb66 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:46.294074 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6031ed-9b54-49fb-84fe-cd1b252abb66 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.305083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991ef9c-d28a-4379-9e51-31db9688a3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.306102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991ef9c-d28a-4379-9e51-31db9688a3de admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.306457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991ef9c-d28a-4379-9e51-31db9688a3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.306648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991ef9c-d28a-4379-9e51-31db9688a3de admin admin] PATH_INFO: `/v3/projects/5ce6e94b122b4290878cad533e85b1bc/users/01747becdac84355b671116fa3f26d27/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.314296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991ef9c-d28a-4379-9e51-31db9688a3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce6e94b122b4290878cad533e85b1bc, user_id=01747becdac84355b671116fa3f26d27, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:46.317451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991ef9c-d28a-4379-9e51-31db9688a3de admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:46.358287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 956/1930] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:46 2022] PUT /identity/v3/projects/5ce6e94b122b4290878cad533e85b1bc/users/01747becdac84355b671116fa3f26d27/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:46.370340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c30a-dd27-4241-a06b-5a30fce50f8a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.371273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c30a-dd27-4241-a06b-5a30fce50f8a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.371857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c30a-dd27-4241-a06b-5a30fce50f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.501664 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3ff2c30a-dd27-4241-a06b-5a30fce50f8a None None] MFA Rules not processed for user `01747becdac84355b671116fa3f26d27`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:46.509327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3ff2c30a-dd27-4241-a06b-5a30fce50f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:46.552515 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991ef9c-d28a-4379-9e51-31db9688a3de admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:46.554790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f991ef9c-d28a-4379-9e51-31db9688a3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:46.668161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991ef9c-d28a-4379-9e51-31db9688a3de admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.675011 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.676191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.677686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.678049 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] PATH_INFO: `/v3/projects/dbeb76fefa9f40ff8aa7cc78fea309bd` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.679600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbeb76fefa9f40ff8aa7cc78fea309bd)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:46.683063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:46.724088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 975/1931] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:46.740176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2c30a-dd27-4241-a06b-5a30fce50f8a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:46.747613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3ff2c30a-dd27-4241-a06b-5a30fce50f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:46.752164 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbeb76fefa9f40ff8aa7cc78fea309bd', 'request_id': 'req-6a359928-1bdb-433e-8fda-f09f3bca72b5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:46.764236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbeb76fefa9f40ff8aa7cc78fea309bd', 'request_id': 'req-6a359928-1bdb-433e-8fda-f09f3bca72b5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:46.772669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbeb76fefa9f40ff8aa7cc78fea309bd', 'request_id': 'req-6a359928-1bdb-433e-8fda-f09f3bca72b5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:46.773862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:46.796060 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] The token cache is being invalidate because project dbeb76fefa9f40ff8aa7cc78fea309bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:46.796473 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:46.797600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:46.802884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 957/1932] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:46 2022] DELETE /identity/v3/projects/dbeb76fefa9f40ff8aa7cc78fea309bd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:46.810193 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:46.811905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:46.894742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2c30a-dd27-4241-a06b-5a30fce50f8a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.897177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359928-1bdb-433e-8fda-f09f3bca72b5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.903149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.904161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.904446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.904791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] PATH_INFO: `/v3/users/6a7e20ef970a4f1abed81a3cfb9e3c31` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.906517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7e20ef970a4f1abed81a3cfb9e3c31)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:46.908839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:46.980727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20f929-df27-455d-ab9d-7121a5012d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.981609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f929-df27-455d-ab9d-7121a5012d37 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.982035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f929-df27-455d-ab9d-7121a5012d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.982391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f929-df27-455d-ab9d-7121a5012d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.983743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7e20ef970a4f1abed81a3cfb9e3c31'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:46.984766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c20f929-df27-455d-ab9d-7121a5012d37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:47.000349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7e20ef970a4f1abed81a3cfb9e3c31'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.011854 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7e20ef970a4f1abed81a3cfb9e3c31'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.013224 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7e20ef970a4f1abed81a3cfb9e3c31'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.026675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7e20ef970a4f1abed81a3cfb9e3c31'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.056349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 958/1933] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:46 2022] DELETE /identity/v3/users/6a7e20ef970a4f1abed81a3cfb9e3c31 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:47.111702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:47.140664 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20f929-df27-455d-ab9d-7121a5012d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:47.142250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20f929-df27-455d-ab9d-7121a5012d37 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:47.164544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 976/1934] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:47.612701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:47.614882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:47.634049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20f929-df27-455d-ab9d-7121a5012d37 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:47.652644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20f929-df27-455d-ab9d-7121a5012d37 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:47.702027 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24decc1-284e-40ec-ab50-53c080a778c3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:47.706733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416540-162e-4010-9030-6914bc3c5174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:47.707647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416540-162e-4010-9030-6914bc3c5174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:47.707927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416540-162e-4010-9030-6914bc3c5174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:47.708472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416540-162e-4010-9030-6914bc3c5174 admin admin] PATH_INFO: `/v3/users/5da7c48c518e4024b7e3f52c132f5918` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:47.710175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80416540-162e-4010-9030-6914bc3c5174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da7c48c518e4024b7e3f52c132f5918)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:47.712243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80416540-162e-4010-9030-6914bc3c5174 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:47.727545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:47.729494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:47.731252 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:47.731558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:47.731831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] PATH_INFO: `/v3/projects/09f02f868d4d45899160cf3bfa347ae9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:47.733370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f02f868d4d45899160cf3bfa347ae9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:47.735355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:47.772066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-80416540-162e-4010-9030-6914bc3c5174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da7c48c518e4024b7e3f52c132f5918'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.788040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-80416540-162e-4010-9030-6914bc3c5174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da7c48c518e4024b7e3f52c132f5918'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.788752 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-80416540-162e-4010-9030-6914bc3c5174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da7c48c518e4024b7e3f52c132f5918'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.789395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-80416540-162e-4010-9030-6914bc3c5174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da7c48c518e4024b7e3f52c132f5918'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.798399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f02f868d4d45899160cf3bfa347ae9', 'request_id': 'req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.798992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-80416540-162e-4010-9030-6914bc3c5174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da7c48c518e4024b7e3f52c132f5918'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.807427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f02f868d4d45899160cf3bfa347ae9', 'request_id': 'req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.814318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f02f868d4d45899160cf3bfa347ae9', 'request_id': 'req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.814688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 959/1935] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:47 2022] DELETE /identity/v3/users/5da7c48c518e4024b7e3f52c132f5918 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:47.819667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0da20-ed16-41dc-ab09-dc2e4cfebf74 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:47.820022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0da20-ed16-41dc-ab09-dc2e4cfebf74 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:47.820359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0da20-ed16-41dc-ab09-dc2e4cfebf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:47.831765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] The token cache is being invalidate because project 09f02f868d4d45899160cf3bfa347ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:47.832059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.832799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3bd85ce2-2a0d-484c-a687-a6490a9a0a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:47.834543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 977/1936] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:47 2022] DELETE /identity/v3/projects/09f02f868d4d45899160cf3bfa347ae9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:47.839159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9da2b-f15e-4abd-b740-75ab66acae49 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:47.839658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9da2b-f15e-4abd-b740-75ab66acae49 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:47.839940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9da2b-f15e-4abd-b740-75ab66acae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:47.843256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ddb0da20-ed16-41dc-ab09-dc2e4cfebf74 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:47.844565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ddb0da20-ed16-41dc-ab09-dc2e4cfebf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:47.858906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fee9da2b-f15e-4abd-b740-75ab66acae49 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:47.860080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fee9da2b-f15e-4abd-b740-75ab66acae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:47.904594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 960/1937] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:47.908712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0da20-ed16-41dc-ab09-dc2e4cfebf74 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:47.910028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ddb0da20-ed16-41dc-ab09-dc2e4cfebf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:47.921480 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 978/1938] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:47.926671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9da2b-f15e-4abd-b740-75ab66acae49 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:47.926671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fee9da2b-f15e-4abd-b740-75ab66acae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:47.941911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:47.975929 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0da20-ed16-41dc-ab09-dc2e4cfebf74 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:47.979836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccfed6-437a-4f55-a741-43bd1e9945a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:47.980507 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccfed6-437a-4f55-a741-43bd1e9945a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:47.980788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccfed6-437a-4f55-a741-43bd1e9945a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:47.981117 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccfed6-437a-4f55-a741-43bd1e9945a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:47.982965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c8ccfed6-437a-4f55-a741-43bd1e9945a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:47.998633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9da2b-f15e-4abd-b740-75ab66acae49 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.003892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb4c12-96c6-4c20-9c52-ddd93e5a4b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.005372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4c12-96c6-4c20-9c52-ddd93e5a4b04 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.005965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4c12-96c6-4c20-9c52-ddd93e5a4b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.006789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4c12-96c6-4c20-9c52-ddd93e5a4b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.020489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb4c12-96c6-4c20-9c52-ddd93e5a4b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.022088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb4c12-96c6-4c20-9c52-ddd93e5a4b04 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.033399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 979/1939] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:48.035188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaba02-6c51-4587-9335-dd065a70e6ea None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.035549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaba02-6c51-4587-9335-dd065a70e6ea None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.035897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaba02-6c51-4587-9335-dd065a70e6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.051474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:48.058603 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-90aaba02-6c51-4587-9335-dd065a70e6ea None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:48.059994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-90aaba02-6c51-4587-9335-dd065a70e6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:48.069922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 980/1940] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:48.074589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaba02-6c51-4587-9335-dd065a70e6ea None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.075006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccfed6-437a-4f55-a741-43bd1e9945a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.077492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccfed6-437a-4f55-a741-43bd1e9945a9 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.098231 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 961/1941] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:48.100923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaba02-6c51-4587-9335-dd065a70e6ea None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.117468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed753d5-bd3c-45d9-84c3-52c126fee51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.118260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed753d5-bd3c-45d9-84c3-52c126fee51d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.118544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed753d5-bd3c-45d9-84c3-52c126fee51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.118862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed753d5-bd3c-45d9-84c3-52c126fee51d admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.120449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed753d5-bd3c-45d9-84c3-52c126fee51d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:48.120822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed753d5-bd3c-45d9-84c3-52c126fee51d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.122540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed753d5-bd3c-45d9-84c3-52c126fee51d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.150216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 981/1942] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:48.151681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccfed6-437a-4f55-a741-43bd1e9945a9 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.168790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccfed6-437a-4f55-a741-43bd1e9945a9 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.175080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4c262-3471-46ba-bb26-dc8d1c61b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.176050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4c262-3471-46ba-bb26-dc8d1c61b81e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.176440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4c262-3471-46ba-bb26-dc8d1c61b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.176800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4c262-3471-46ba-bb26-dc8d1c61b81e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.177647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4c262-3471-46ba-bb26-dc8d1c61b81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.179680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4c262-3471-46ba-bb26-dc8d1c61b81e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.218279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 962/1943] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:48 2022] POST /identity/v3/projects => generated 397 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:48.219900 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed753d5-bd3c-45d9-84c3-52c126fee51d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.235773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed753d5-bd3c-45d9-84c3-52c126fee51d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.318211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d41c6-10e9-476d-a93c-727609676e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.318909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d41c6-10e9-476d-a93c-727609676e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.319289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d41c6-10e9-476d-a93c-727609676e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.319457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d41c6-10e9-476d-a93c-727609676e67 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.320312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d41c6-10e9-476d-a93c-727609676e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.323091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d41c6-10e9-476d-a93c-727609676e67 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.347653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 982/1944] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:48 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:31:48.351664 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4c262-3471-46ba-bb26-dc8d1c61b81e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.367128 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4c262-3471-46ba-bb26-dc8d1c61b81e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.373997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00124a-2c60-4e79-a436-0fc1be4a1ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.374758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00124a-2c60-4e79-a436-0fc1be4a1ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.375077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00124a-2c60-4e79-a436-0fc1be4a1ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.375359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00124a-2c60-4e79-a436-0fc1be4a1ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.376130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00124a-2c60-4e79-a436-0fc1be4a1ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.378040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00124a-2c60-4e79-a436-0fc1be4a1ed4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.390124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 963/1945] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:48.394043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d41c6-10e9-476d-a93c-727609676e67 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.453163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d41c6-10e9-476d-a93c-727609676e67 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.468200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627c13e-32e7-4ea6-b73b-12d9d8b3ff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.469043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c13e-32e7-4ea6-b73b-12d9d8b3ff36 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.469330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c13e-32e7-4ea6-b73b-12d9d8b3ff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.469608 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c13e-32e7-4ea6-b73b-12d9d8b3ff36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.471990 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627c13e-32e7-4ea6-b73b-12d9d8b3ff36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.471990 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627c13e-32e7-4ea6-b73b-12d9d8b3ff36 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.486569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 983/1946] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:48.491613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00124a-2c60-4e79-a436-0fc1be4a1ed4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.502820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00124a-2c60-4e79-a436-0fc1be4a1ed4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.523269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487ce7-7202-4487-b54e-b5dc379a4964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.524400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487ce7-7202-4487-b54e-b5dc379a4964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.524860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487ce7-7202-4487-b54e-b5dc379a4964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.525710 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487ce7-7202-4487-b54e-b5dc379a4964 admin admin] PATH_INFO: `/v3/projects/ea632bcd31d64e77bf337fe4c2e27817/users/5bc96045b1304657b4253b003b2d4ae1/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.540560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627c13e-32e7-4ea6-b73b-12d9d8b3ff36 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.542950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1627c13e-32e7-4ea6-b73b-12d9d8b3ff36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:48.547426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6487ce7-7202-4487-b54e-b5dc379a4964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea632bcd31d64e77bf337fe4c2e27817, user_id=5bc96045b1304657b4253b003b2d4ae1, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.550232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6487ce7-7202-4487-b54e-b5dc379a4964 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.561547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627c13e-32e7-4ea6-b73b-12d9d8b3ff36 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.577747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 964/1947] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:48 2022] PUT /identity/v3/projects/ea632bcd31d64e77bf337fe4c2e27817/users/5bc96045b1304657b4253b003b2d4ae1/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:48.579668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04243-9ea2-4f49-bf24-4526fe868a67 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.580060 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04243-9ea2-4f49-bf24-4526fe868a67 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.580369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04243-9ea2-4f49-bf24-4526fe868a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.619456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-36d04243-9ea2-4f49-bf24-4526fe868a67 None None] MFA Rules not processed for user `5bc96045b1304657b4253b003b2d4ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:48.620904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-36d04243-9ea2-4f49-bf24-4526fe868a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:48.658340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.659213 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.659492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.659765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] PATH_INFO: `/v3/projects/30f3c74b2dd74a8caa8a6dcab8823493` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.660994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30f3c74b2dd74a8caa8a6dcab8823493)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.662992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.692852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:48.711656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 965/1948] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:48.716748 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d04243-9ea2-4f49-bf24-4526fe868a67 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.729870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d04243-9ea2-4f49-bf24-4526fe868a67 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.731496 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30f3c74b2dd74a8caa8a6dcab8823493', 'request_id': 'req-d55946d4-624b-4bf9-a4ad-dc64384d0558'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:48.740640 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30f3c74b2dd74a8caa8a6dcab8823493', 'request_id': 'req-d55946d4-624b-4bf9-a4ad-dc64384d0558'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:48.746808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30f3c74b2dd74a8caa8a6dcab8823493', 'request_id': 'req-d55946d4-624b-4bf9-a4ad-dc64384d0558'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:48.759772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] The token cache is being invalidate because project 30f3c74b2dd74a8caa8a6dcab8823493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:48.760063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:48.760752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d55946d4-624b-4bf9-a4ad-dc64384d0558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:48.762355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 984/1949] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:48 2022] DELETE /identity/v3/projects/30f3c74b2dd74a8caa8a6dcab8823493 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:48.767198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f93ae8-0041-477a-bdf6-d7cbe9868c21 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.767484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f93ae8-0041-477a-bdf6-d7cbe9868c21 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.767757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f93ae8-0041-477a-bdf6-d7cbe9868c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.785264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-70f93ae8-0041-477a-bdf6-d7cbe9868c21 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:48.786624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-70f93ae8-0041-477a-bdf6-d7cbe9868c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:48.792030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494bbb9-2274-47b1-b9a7-71e380db75c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.792732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494bbb9-2274-47b1-b9a7-71e380db75c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.793057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494bbb9-2274-47b1-b9a7-71e380db75c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.793426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494bbb9-2274-47b1-b9a7-71e380db75c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.794112 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494bbb9-2274-47b1-b9a7-71e380db75c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.796107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494bbb9-2274-47b1-b9a7-71e380db75c0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.823526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 966/1950] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:48 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:48.827284 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494bbb9-2274-47b1-b9a7-71e380db75c0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.829273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a494bbb9-2274-47b1-b9a7-71e380db75c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:48.835354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:48.855993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 985/1951] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:48.863901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956ec0c-d635-4de2-a63f-84fafb026ddd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.864499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956ec0c-d635-4de2-a63f-84fafb026ddd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.864780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956ec0c-d635-4de2-a63f-84fafb026ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.883119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6956ec0c-d635-4de2-a63f-84fafb026ddd None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:48.884316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6956ec0c-d635-4de2-a63f-84fafb026ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:48.896525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494bbb9-2274-47b1-b9a7-71e380db75c0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.901641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab10db-bb7b-4367-966e-596b92568926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.902323 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab10db-bb7b-4367-966e-596b92568926 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.902609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab10db-bb7b-4367-966e-596b92568926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.902888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab10db-bb7b-4367-966e-596b92568926 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.903588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab10db-bb7b-4367-966e-596b92568926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.905565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab10db-bb7b-4367-966e-596b92568926 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.928702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 967/1952] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:48 2022] POST /identity/v3/users => generated 307 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:48.929821 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab10db-bb7b-4367-966e-596b92568926 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.939812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab10db-bb7b-4367-966e-596b92568926 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.944356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0a869-cb20-4452-8405-3044cb1fba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.945030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a869-cb20-4452-8405-3044cb1fba2d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.945312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a869-cb20-4452-8405-3044cb1fba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.945590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a869-cb20-4452-8405-3044cb1fba2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.946367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0a869-cb20-4452-8405-3044cb1fba2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.947635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 986/1953] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:48.947943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0a869-cb20-4452-8405-3044cb1fba2d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.951991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956ec0c-d635-4de2-a63f-84fafb026ddd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.961076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956ec0c-d635-4de2-a63f-84fafb026ddd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.962548 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 968/1954] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:31:48.965843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b005122-a3ae-403e-be5e-1013851ecf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.966291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0a869-cb20-4452-8405-3044cb1fba2d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.966485 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b005122-a3ae-403e-be5e-1013851ecf7a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.966763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b005122-a3ae-403e-be5e-1013851ecf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.967033 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b005122-a3ae-403e-be5e-1013851ecf7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.967751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b005122-a3ae-403e-be5e-1013851ecf7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:48.968050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b005122-a3ae-403e-be5e-1013851ecf7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.969813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b005122-a3ae-403e-be5e-1013851ecf7a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.976193 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0a869-cb20-4452-8405-3044cb1fba2d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.980869 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af4a78-c786-4b35-a595-05170a9aa6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.981811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af4a78-c786-4b35-a595-05170a9aa6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.982124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af4a78-c786-4b35-a595-05170a9aa6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.982254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 987/1955] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:31:48.982421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af4a78-c786-4b35-a595-05170a9aa6dc admin admin] PATH_INFO: `/v3/projects/cb75acc4f8d543d1a15d4bb6def03227/users/161a634b45614b4f8ef05fd642a354c7/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.986498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b005122-a3ae-403e-be5e-1013851ecf7a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.996361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b005122-a3ae-403e-be5e-1013851ecf7a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.998196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af4a78-c786-4b35-a595-05170a9aa6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb75acc4f8d543d1a15d4bb6def03227, user_id=161a634b45614b4f8ef05fd642a354c7, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:49.001023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af4a78-c786-4b35-a595-05170a9aa6dc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:49.001237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bc8cc-acd7-41c6-862c-1ed5841db111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:49.001873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bc8cc-acd7-41c6-862c-1ed5841db111 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.002156 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bc8cc-acd7-41c6-862c-1ed5841db111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.002427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bc8cc-acd7-41c6-862c-1ed5841db111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.003129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bc8cc-acd7-41c6-862c-1ed5841db111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:49.005106 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bc8cc-acd7-41c6-862c-1ed5841db111 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:49.015130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 969/1956] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:48 2022] PUT /identity/v3/projects/cb75acc4f8d543d1a15d4bb6def03227/users/161a634b45614b4f8ef05fd642a354c7/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:49.018941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af4a78-c786-4b35-a595-05170a9aa6dc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:49.032478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 988/1957] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:31:48 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:49.036932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bc8cc-acd7-41c6-862c-1ed5841db111 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:49.051883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:49.092437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af4a78-c786-4b35-a595-05170a9aa6dc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:49.104309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bc8cc-acd7-41c6-862c-1ed5841db111 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:49.109708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f545-eed6-4d4b-a4b6-79f484ab915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:49.110387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f545-eed6-4d4b-a4b6-79f484ab915c admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.110669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f545-eed6-4d4b-a4b6-79f484ab915c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.110964 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f545-eed6-4d4b-a4b6-79f484ab915c admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.111643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685f545-eed6-4d4b-a4b6-79f484ab915c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:49.113762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685f545-eed6-4d4b-a4b6-79f484ab915c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:49.135283 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 989/1958] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:31:49 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:49.139356 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f545-eed6-4d4b-a4b6-79f484ab915c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:49.149040 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f545-eed6-4d4b-a4b6-79f484ab915c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:49.151332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357323b0-9ee9-49fa-8a62-35fe926aa183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:49.152045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357323b0-9ee9-49fa-8a62-35fe926aa183 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.152334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357323b0-9ee9-49fa-8a62-35fe926aa183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.152608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357323b0-9ee9-49fa-8a62-35fe926aa183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.153368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357323b0-9ee9-49fa-8a62-35fe926aa183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:49.153650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e896cb-26f9-4248-b1ba-dcd3b7753668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:49.154297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e896cb-26f9-4248-b1ba-dcd3b7753668 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.154605 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e896cb-26f9-4248-b1ba-dcd3b7753668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.154877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e896cb-26f9-4248-b1ba-dcd3b7753668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.154964 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357323b0-9ee9-49fa-8a62-35fe926aa183 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:49.155649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e896cb-26f9-4248-b1ba-dcd3b7753668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:49.157420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e896cb-26f9-4248-b1ba-dcd3b7753668 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:49.164988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 970/1959] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:31:49.169002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 990/1960] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:31:49.171460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357323b0-9ee9-49fa-8a62-35fe926aa183 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:49.171586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e896cb-26f9-4248-b1ba-dcd3b7753668 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:49.176801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:49.181684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e896cb-26f9-4248-b1ba-dcd3b7753668 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:49.183547 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357323b0-9ee9-49fa-8a62-35fe926aa183 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:49.186631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9c0aa-9642-42be-a809-c7a7e469f351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:49.187413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9c0aa-9642-42be-a809-c7a7e469f351 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.187775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9c0aa-9642-42be-a809-c7a7e469f351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.188035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9c0aa-9642-42be-a809-c7a7e469f351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.188715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9c0aa-9642-42be-a809-c7a7e469f351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:49.190325 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9c0aa-9642-42be-a809-c7a7e469f351 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:49.191712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d031eb-19cc-40df-8812-e41a026cadac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:49.192739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d031eb-19cc-40df-8812-e41a026cadac admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.193051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d031eb-19cc-40df-8812-e41a026cadac admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.193328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d031eb-19cc-40df-8812-e41a026cadac admin admin] PATH_INFO: `/v3/projects/cb75acc4f8d543d1a15d4bb6def03227/users/161a634b45614b4f8ef05fd642a354c7/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.195467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d031eb-19cc-40df-8812-e41a026cadac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb75acc4f8d543d1a15d4bb6def03227, user_id=161a634b45614b4f8ef05fd642a354c7, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:49.198200 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d031eb-19cc-40df-8812-e41a026cadac admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:49.206387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 991/1961] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:31:49.207570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9c0aa-9642-42be-a809-c7a7e469f351 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:49.208927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 971/1962] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:49 2022] PUT /identity/v3/projects/cb75acc4f8d543d1a15d4bb6def03227/users/161a634b45614b4f8ef05fd642a354c7/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:49.217434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9c0aa-9642-42be-a809-c7a7e469f351 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:49.220147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467890-2e77-49d7-a73e-d937c0b5d778 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.220428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467890-2e77-49d7-a73e-d937c0b5d778 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.220721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467890-2e77-49d7-a73e-d937c0b5d778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.247349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f7467890-2e77-49d7-a73e-d937c0b5d778 None None] MFA Rules not processed for user `161a634b45614b4f8ef05fd642a354c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:49.248545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f7467890-2e77-49d7-a73e-d937c0b5d778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:49.272938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2145d6b-317a-4924-8ce9-1bd2babeef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:49.273897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2145d6b-317a-4924-8ce9-1bd2babeef90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.274208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2145d6b-317a-4924-8ce9-1bd2babeef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.274481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2145d6b-317a-4924-8ce9-1bd2babeef90 admin admin] PATH_INFO: `/v3/projects/fb6c87546c424fde9c5ba84b67c516fa/users/d14b072a699240678077d45ad2c65d91/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.288811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2145d6b-317a-4924-8ce9-1bd2babeef90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6c87546c424fde9c5ba84b67c516fa, user_id=d14b072a699240678077d45ad2c65d91, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:49.291502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2145d6b-317a-4924-8ce9-1bd2babeef90 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:49.305261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 992/1963] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:31:49 2022] PUT /identity/v3/projects/fb6c87546c424fde9c5ba84b67c516fa/users/d14b072a699240678077d45ad2c65d91/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:49.315575 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8fa31-c8e9-4a46-9fbd-d31a289786ab None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.315870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8fa31-c8e9-4a46-9fbd-d31a289786ab None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.316151 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8fa31-c8e9-4a46-9fbd-d31a289786ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.321880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 972/1964] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:49.332348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7467890-2e77-49d7-a73e-d937c0b5d778 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:49.333723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f7467890-2e77-49d7-a73e-d937c0b5d778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:49.346630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-27b8fa31-c8e9-4a46-9fbd-d31a289786ab None None] MFA Rules not processed for user `d14b072a699240678077d45ad2c65d91`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:49.347829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-27b8fa31-c8e9-4a46-9fbd-d31a289786ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:49.392950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7467890-2e77-49d7-a73e-d937c0b5d778 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:49.405653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:49.421154 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 993/1965] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:49.432470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8fa31-c8e9-4a46-9fbd-d31a289786ab None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:49.433905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-27b8fa31-c8e9-4a46-9fbd-d31a289786ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:49.458986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8503556-4b9e-4004-a857-09065bdd35d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:49.460340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503556-4b9e-4004-a857-09065bdd35d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.460629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503556-4b9e-4004-a857-09065bdd35d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.460916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503556-4b9e-4004-a857-09065bdd35d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.493511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8fa31-c8e9-4a46-9fbd-d31a289786ab None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:49.497884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b085df-0f6d-4767-9547-286b75a127d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:49.498737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b085df-0f6d-4767-9547-286b75a127d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.499021 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b085df-0f6d-4767-9547-286b75a127d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.499426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b085df-0f6d-4767-9547-286b75a127d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.510095 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b085df-0f6d-4767-9547-286b75a127d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:49.511529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b085df-0f6d-4767-9547-286b75a127d2 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:49.519644 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:49.521399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 994/1966] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:31:49.540916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8503556-4b9e-4004-a857-09065bdd35d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:49.542592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8503556-4b9e-4004-a857-09065bdd35d8 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:49.552975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 973/1967] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:49 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:31:49.692887 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b085df-0f6d-4767-9547-286b75a127d2 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:49.702612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b085df-0f6d-4767-9547-286b75a127d2 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:49.706606 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffd1d4-c188-4807-9118-92b59b23f937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:49.707267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd1d4-c188-4807-9118-92b59b23f937 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:49.707539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd1d4-c188-4807-9118-92b59b23f937 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:49.708134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd1d4-c188-4807-9118-92b59b23f937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:49.709629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-55ffd1d4-c188-4807-9118-92b59b23f937 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:49.789278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffd1d4-c188-4807-9118-92b59b23f937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:49.791091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffd1d4-c188-4807-9118-92b59b23f937 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:49.801691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 995/1968] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:55.533538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8503556-4b9e-4004-a857-09065bdd35d8 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:55.548775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8503556-4b9e-4004-a857-09065bdd35d8 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:55.552849 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b4fb-08e0-4307-94a0-1af5917e58a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:55.553616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b4fb-08e0-4307-94a0-1af5917e58a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:55.553886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b4fb-08e0-4307-94a0-1af5917e58a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:55.554154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b4fb-08e0-4307-94a0-1af5917e58a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:55.555953 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1423b4fb-08e0-4307-94a0-1af5917e58a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:55.619910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b4fb-08e0-4307-94a0-1af5917e58a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:55.621397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b4fb-08e0-4307-94a0-1af5917e58a9 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:55.630988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 974/1969] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:58.506875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffd1d4-c188-4807-9118-92b59b23f937 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:58.649037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffd1d4-c188-4807-9118-92b59b23f937 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:58.662925 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:58.663838 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:58.664191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:58.664470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] PATH_INFO: `/v3/users/5bc96045b1304657b4253b003b2d4ae1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:58.671116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc96045b1304657b4253b003b2d4ae1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:58.678011 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:58.825699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:58.848445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc96045b1304657b4253b003b2d4ae1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:58.864362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc96045b1304657b4253b003b2d4ae1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:58.865170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc96045b1304657b4253b003b2d4ae1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:58.874863 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc96045b1304657b4253b003b2d4ae1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:58.883995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc96045b1304657b4253b003b2d4ae1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:58.910845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 996/1970] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:58 2022] DELETE /identity/v3/users/5bc96045b1304657b4253b003b2d4ae1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:58.915736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ec064-3713-436e-b749-d0a282540d61 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:58.916205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ec064-3713-436e-b749-d0a282540d61 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:58.916314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ec064-3713-436e-b749-d0a282540d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:58.957690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ae7ec064-3713-436e-b749-d0a282540d61 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:58.959534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ae7ec064-3713-436e-b749-d0a282540d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:59.038046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 975/1971] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:31:59.048805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:59.050390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:59.121949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845fff2-0420-40e8-a413-83742a6f0e7d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:59.125659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b6a6b-5d4e-4081-883e-52dd720a5568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:59.126323 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b6a6b-5d4e-4081-883e-52dd720a5568 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:59.126605 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b6a6b-5d4e-4081-883e-52dd720a5568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:59.126904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b6a6b-5d4e-4081-883e-52dd720a5568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:59.137711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b6a6b-5d4e-4081-883e-52dd720a5568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:59.139369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b6a6b-5d4e-4081-883e-52dd720a5568 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:59.158709 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 997/1972] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:31:59.424813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ec064-3713-436e-b749-d0a282540d61 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:59.426491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ae7ec064-3713-436e-b749-d0a282540d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:59.441481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ec064-3713-436e-b749-d0a282540d61 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:59.442681 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b6a6b-5d4e-4081-883e-52dd720a5568 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:59.444145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-362b6a6b-5d4e-4081-883e-52dd720a5568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:59.444828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79663ea0-4624-4d5d-8efa-e0eaf4715e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:59.445815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79663ea0-4624-4d5d-8efa-e0eaf4715e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:59.446095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79663ea0-4624-4d5d-8efa-e0eaf4715e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:59.446371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79663ea0-4624-4d5d-8efa-e0eaf4715e28 admin admin] PATH_INFO: `/v3/users/72be9cf57e3d4ca28362d1cf923cbd90` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:59.447872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79663ea0-4624-4d5d-8efa-e0eaf4715e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72be9cf57e3d4ca28362d1cf923cbd90)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:59.451376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79663ea0-4624-4d5d-8efa-e0eaf4715e28 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:59.457822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b6a6b-5d4e-4081-883e-52dd720a5568 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:59.464625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:59.466136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:59.466504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:59.466922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] PATH_INFO: `/v3/projects/ea632bcd31d64e77bf337fe4c2e27817` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:59.468545 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea632bcd31d64e77bf337fe4c2e27817)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:59.470892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:59.512478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-79663ea0-4624-4d5d-8efa-e0eaf4715e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72be9cf57e3d4ca28362d1cf923cbd90'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.525306 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-79663ea0-4624-4d5d-8efa-e0eaf4715e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72be9cf57e3d4ca28362d1cf923cbd90'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.526287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-79663ea0-4624-4d5d-8efa-e0eaf4715e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72be9cf57e3d4ca28362d1cf923cbd90'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.526900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-79663ea0-4624-4d5d-8efa-e0eaf4715e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72be9cf57e3d4ca28362d1cf923cbd90'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.528362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea632bcd31d64e77bf337fe4c2e27817', 'request_id': 'req-92318ce0-d615-4496-bc42-aec39ee1c39a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.536397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-79663ea0-4624-4d5d-8efa-e0eaf4715e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72be9cf57e3d4ca28362d1cf923cbd90'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.538754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:59.540278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea632bcd31d64e77bf337fe4c2e27817', 'request_id': 'req-92318ce0-d615-4496-bc42-aec39ee1c39a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.547236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea632bcd31d64e77bf337fe4c2e27817', 'request_id': 'req-92318ce0-d615-4496-bc42-aec39ee1c39a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.559057 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] The token cache is being invalidate because project ea632bcd31d64e77bf337fe4c2e27817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:31:59.559341 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.559811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 976/1973] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:59 2022] DELETE /identity/v3/users/72be9cf57e3d4ca28362d1cf923cbd90 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:59.563090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.564446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cec255-13ba-458c-9636-781b7da2905a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:59.564870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cec255-13ba-458c-9636-781b7da2905a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:59.565017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 998/1974] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:31:59 2022] DELETE /identity/v3/projects/ea632bcd31d64e77bf337fe4c2e27817 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:59.565182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cec255-13ba-458c-9636-781b7da2905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:59.568479 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:59.569849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:59.588503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-91cec255-13ba-458c-9636-781b7da2905a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:59.590123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-91cec255-13ba-458c-9636-781b7da2905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:59.633989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:59.658021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 977/1975] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:31:59.659389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92318ce0-d615-4496-bc42-aec39ee1c39a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:59.664170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:59.665107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:59.665392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:59.665670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] PATH_INFO: `/v3/users/161a634b45614b4f8ef05fd642a354c7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:59.666937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] RBAC: Authorizing `identity:delete_user(user_id=161a634b45614b4f8ef05fd642a354c7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:59.667779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cec255-13ba-458c-9636-781b7da2905a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:59.668938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:59.669170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-91cec255-13ba-458c-9636-781b7da2905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:59.719261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161a634b45614b4f8ef05fd642a354c7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.731374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cec255-13ba-458c-9636-781b7da2905a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:59.731726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161a634b45614b4f8ef05fd642a354c7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.732402 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161a634b45614b4f8ef05fd642a354c7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.735024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047ec2a-5b1c-40e6-b3b2-40468a5bc200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:59.735691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ec2a-5b1c-40e6-b3b2-40468a5bc200 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:59.735971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ec2a-5b1c-40e6-b3b2-40468a5bc200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:59.736244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ec2a-5b1c-40e6-b3b2-40468a5bc200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:59.741281 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161a634b45614b4f8ef05fd642a354c7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.747469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047ec2a-5b1c-40e6-b3b2-40468a5bc200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:59.748905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161a634b45614b4f8ef05fd642a354c7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:31:59.749058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047ec2a-5b1c-40e6-b3b2-40468a5bc200 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:59.755233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 999/1976] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:31:59 2022] DELETE /identity/v3/users/161a634b45614b4f8ef05fd642a354c7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:31:59.758680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 978/1977] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:32:00.241264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.242859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:00.282234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047ec2a-5b1c-40e6-b3b2-40468a5bc200 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.295038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047ec2a-5b1c-40e6-b3b2-40468a5bc200 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:00.390418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc92af-064c-40c3-9eeb-f1c34e95711f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:00.397644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:00.399339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.399760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.400255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] PATH_INFO: `/v3/projects/9308a76f32bb415e95e7bb8bdae6be87` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.401961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9308a76f32bb415e95e7bb8bdae6be87)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:00.405076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:00.409647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:00.410613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.410894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.411168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] PATH_INFO: `/v3/projects/cb75acc4f8d543d1a15d4bb6def03227` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.412518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb75acc4f8d543d1a15d4bb6def03227)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:00.414834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:00.460932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:00.465160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9308a76f32bb415e95e7bb8bdae6be87', 'request_id': 'req-fa9416d9-72f4-4fe1-8337-68e747af6d4f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.473388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9308a76f32bb415e95e7bb8bdae6be87', 'request_id': 'req-fa9416d9-72f4-4fe1-8337-68e747af6d4f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.477439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb75acc4f8d543d1a15d4bb6def03227', 'request_id': 'req-a7204d21-b066-40c2-95d2-2784aa32a2ec'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.477769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:00.479992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9308a76f32bb415e95e7bb8bdae6be87', 'request_id': 'req-fa9416d9-72f4-4fe1-8337-68e747af6d4f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.485899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb75acc4f8d543d1a15d4bb6def03227', 'request_id': 'req-a7204d21-b066-40c2-95d2-2784aa32a2ec'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.492218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb75acc4f8d543d1a15d4bb6def03227', 'request_id': 'req-a7204d21-b066-40c2-95d2-2784aa32a2ec'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.493974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] The token cache is being invalidate because project 9308a76f32bb415e95e7bb8bdae6be87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:00.494259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.494885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.496665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1000/1978] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:00 2022] DELETE /identity/v3/projects/9308a76f32bb415e95e7bb8bdae6be87 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:00.500318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.501679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:00.503744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] The token cache is being invalidate because project cb75acc4f8d543d1a15d4bb6def03227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:00.504032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.504646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7204d21-b066-40c2-95d2-2784aa32a2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.509603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 979/1979] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:00 2022] DELETE /identity/v3/projects/cb75acc4f8d543d1a15d4bb6def03227 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:00.511468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036fde3-6c3d-4c25-a736-95131796f4dd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.511819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036fde3-6c3d-4c25-a736-95131796f4dd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.512099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036fde3-6c3d-4c25-a736-95131796f4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.530347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7036fde3-6c3d-4c25-a736-95131796f4dd None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:00.531747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7036fde3-6c3d-4c25-a736-95131796f4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:00.567322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9416d9-72f4-4fe1-8337-68e747af6d4f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:00.589993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 980/1980] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:00.597688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2aec-85f4-4ba6-9c8b-140fc642239c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.597994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2aec-85f4-4ba6-9c8b-140fc642239c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.598271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2aec-85f4-4ba6-9c8b-140fc642239c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.617549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ec1c2aec-85f4-4ba6-9c8b-140fc642239c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:00.618938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ec1c2aec-85f4-4ba6-9c8b-140fc642239c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:00.625672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:00.626569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.626842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.627107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] PATH_INFO: `/v3/users/6ee4eef6f60c4fa4bf8ff4b3f6ecc28c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.627350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 981/1981] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:00.630016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee4eef6f60c4fa4bf8ff4b3f6ecc28c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:00.631573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2aec-85f4-4ba6-9c8b-140fc642239c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.632031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:00.640502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2aec-85f4-4ba6-9c8b-140fc642239c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:00.645007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b039e-74a2-4ed2-8f50-8f7c07b86654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:00.645673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b039e-74a2-4ed2-8f50-8f7c07b86654 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.645949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b039e-74a2-4ed2-8f50-8f7c07b86654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.646216 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b039e-74a2-4ed2-8f50-8f7c07b86654 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.646942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b039e-74a2-4ed2-8f50-8f7c07b86654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:00.647244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b039e-74a2-4ed2-8f50-8f7c07b86654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:00.649128 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b039e-74a2-4ed2-8f50-8f7c07b86654 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:00.664815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 982/1982] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:32:00.666552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b039e-74a2-4ed2-8f50-8f7c07b86654 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.677432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b039e-74a2-4ed2-8f50-8f7c07b86654 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:00.682135 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68910d2d-66ac-4ab0-b950-9b1377211aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:00.682886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910d2d-66ac-4ab0-b950-9b1377211aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.683167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910d2d-66ac-4ab0-b950-9b1377211aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.683440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910d2d-66ac-4ab0-b950-9b1377211aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.684565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68910d2d-66ac-4ab0-b950-9b1377211aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:00.686185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68910d2d-66ac-4ab0-b950-9b1377211aa0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:00.688713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee4eef6f60c4fa4bf8ff4b3f6ecc28c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.703003 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee4eef6f60c4fa4bf8ff4b3f6ecc28c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.703941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee4eef6f60c4fa4bf8ff4b3f6ecc28c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.714525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee4eef6f60c4fa4bf8ff4b3f6ecc28c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.719023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 983/1983] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:00 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:00.722295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee4eef6f60c4fa4bf8ff4b3f6ecc28c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:00.722933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68910d2d-66ac-4ab0-b950-9b1377211aa0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.724501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-68910d2d-66ac-4ab0-b950-9b1377211aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:00.731947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1001/1984] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:00 2022] DELETE /identity/v3/users/6ee4eef6f60c4fa4bf8ff4b3f6ecc28c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:00.814935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68910d2d-66ac-4ab0-b950-9b1377211aa0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:00.854893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:00.893178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b1a0d-3481-43b4-a861-edc97bee16b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:00.893958 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1a0d-3481-43b4-a861-edc97bee16b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.894329 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1a0d-3481-43b4-a861-edc97bee16b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.894511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1a0d-3481-43b4-a861-edc97bee16b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.895236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b1a0d-3481-43b4-a861-edc97bee16b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:00.897374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b1a0d-3481-43b4-a861-edc97bee16b4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:00.920382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 984/1985] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:00 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:00.924654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.935854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51a416-ac90-437e-b465-628346d5f98d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:00.940342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038c7b5-df52-4512-be9e-09e39a7864f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:00.941128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038c7b5-df52-4512-be9e-09e39a7864f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.941475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038c7b5-df52-4512-be9e-09e39a7864f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.941807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038c7b5-df52-4512-be9e-09e39a7864f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.942607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038c7b5-df52-4512-be9e-09e39a7864f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:00.944335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038c7b5-df52-4512-be9e-09e39a7864f6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:00.954709 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1002/1986] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:00.958785 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b1a0d-3481-43b4-a861-edc97bee16b4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.969342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b1a0d-3481-43b4-a861-edc97bee16b4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:00.974158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f9d7e-305f-48df-9f7a-283a548e07a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:00.974834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f9d7e-305f-48df-9f7a-283a548e07a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.975115 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f9d7e-305f-48df-9f7a-283a548e07a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.975390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f9d7e-305f-48df-9f7a-283a548e07a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.976128 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f9d7e-305f-48df-9f7a-283a548e07a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:00.977896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f9d7e-305f-48df-9f7a-283a548e07a9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:00.988085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 985/1987] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:00.992657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038c7b5-df52-4512-be9e-09e39a7864f6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.999416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:01.004083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038c7b5-df52-4512-be9e-09e39a7864f6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.010428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9802a40-dc59-4fe8-9f70-9e990e2b3c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.011406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802a40-dc59-4fe8-9f70-9e990e2b3c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.011712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802a40-dc59-4fe8-9f70-9e990e2b3c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.012210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802a40-dc59-4fe8-9f70-9e990e2b3c72 admin admin] PATH_INFO: `/v3/projects/7896b3de67f94529a525d26c7d09f64e/users/755c65ad4e294e48aa9e81aa7b54e192/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.025882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f9d7e-305f-48df-9f7a-283a548e07a9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.028037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-608f9d7e-305f-48df-9f7a-283a548e07a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:01.029759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9802a40-dc59-4fe8-9f70-9e990e2b3c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7896b3de67f94529a525d26c7d09f64e, user_id=755c65ad4e294e48aa9e81aa7b54e192, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.032541 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9802a40-dc59-4fe8-9f70-9e990e2b3c72 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.041894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f9d7e-305f-48df-9f7a-283a548e07a9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.048003 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.049138 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.049458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.049805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] PATH_INFO: `/v3/projects/66d3057ca7b04f25ba8a5b0347a8d15e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.051166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d3057ca7b04f25ba8a5b0347a8d15e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.053095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.058240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1003/1988] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:00 2022] PUT /identity/v3/projects/7896b3de67f94529a525d26c7d09f64e/users/755c65ad4e294e48aa9e81aa7b54e192/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:01.068946 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692bac7-a68a-49c4-8190-f34b7570ec22 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.069253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692bac7-a68a-49c4-8190-f34b7570ec22 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.069552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692bac7-a68a-49c4-8190-f34b7570ec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.097688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7692bac7-a68a-49c4-8190-f34b7570ec22 None None] MFA Rules not processed for user `755c65ad4e294e48aa9e81aa7b54e192`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:01.098892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7692bac7-a68a-49c4-8190-f34b7570ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:01.104465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d3057ca7b04f25ba8a5b0347a8d15e', 'request_id': 'req-996de0d8-8417-404f-89ff-67a13c871af2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.113333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d3057ca7b04f25ba8a5b0347a8d15e', 'request_id': 'req-996de0d8-8417-404f-89ff-67a13c871af2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.119924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d3057ca7b04f25ba8a5b0347a8d15e', 'request_id': 'req-996de0d8-8417-404f-89ff-67a13c871af2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.131901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] The token cache is being invalidate because project 66d3057ca7b04f25ba8a5b0347a8d15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:01.132313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.133176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.134869 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 986/1989] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:01 2022] DELETE /identity/v3/projects/66d3057ca7b04f25ba8a5b0347a8d15e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:01.138726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.140241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:01.166573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1004/1990] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:01.171092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692bac7-a68a-49c4-8190-f34b7570ec22 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.172401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7692bac7-a68a-49c4-8190-f34b7570ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:01.204844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996de0d8-8417-404f-89ff-67a13c871af2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.210218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.211256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.211597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.211922 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] PATH_INFO: `/v3/users/01747becdac84355b671116fa3f26d27` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.213633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01747becdac84355b671116fa3f26d27)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.215655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.244604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692bac7-a68a-49c4-8190-f34b7570ec22 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.250859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea8c5d-a753-4595-9ddc-3e5d3a068c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.251755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8c5d-a753-4595-9ddc-3e5d3a068c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.252200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8c5d-a753-4595-9ddc-3e5d3a068c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.252596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8c5d-a753-4595-9ddc-3e5d3a068c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.253402 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea8c5d-a753-4595-9ddc-3e5d3a068c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.255550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea8c5d-a753-4595-9ddc-3e5d3a068c79 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.260106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:01.274541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01747becdac84355b671116fa3f26d27'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.284988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1005/1991] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:01 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:01.288652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea8c5d-a753-4595-9ddc-3e5d3a068c79 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.293119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01747becdac84355b671116fa3f26d27'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.294831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01747becdac84355b671116fa3f26d27'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.295465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01747becdac84355b671116fa3f26d27'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.304570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01747becdac84355b671116fa3f26d27'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.317987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 987/1992] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:01 2022] DELETE /identity/v3/users/01747becdac84355b671116fa3f26d27 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:01.367404 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:01.373660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea8c5d-a753-4595-9ddc-3e5d3a068c79 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.438313 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707d01e-fac5-4022-ae32-b4bab0fb9817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.439090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707d01e-fac5-4022-ae32-b4bab0fb9817 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.439442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707d01e-fac5-4022-ae32-b4bab0fb9817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.439816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707d01e-fac5-4022-ae32-b4bab0fb9817 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.440579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707d01e-fac5-4022-ae32-b4bab0fb9817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.442749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707d01e-fac5-4022-ae32-b4bab0fb9817 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.468437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1006/1993] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:01 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:01.475127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.477241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:01.506418 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce025eba-99b9-499b-b0b2-5bfc3302c897 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.512053 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a7a7d-d299-43db-b00c-133e1fff4bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.512765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a7a7d-d299-43db-b00c-133e1fff4bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.513117 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a7a7d-d299-43db-b00c-133e1fff4bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.513399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a7a7d-d299-43db-b00c-133e1fff4bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.514184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a7a7d-d299-43db-b00c-133e1fff4bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.516310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a7a7d-d299-43db-b00c-133e1fff4bd6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.528423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 988/1994] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:01.532866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707d01e-fac5-4022-ae32-b4bab0fb9817 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.544468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707d01e-fac5-4022-ae32-b4bab0fb9817 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.549649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87b6b6-a5d3-4d29-afdc-400b1f252156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.550558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87b6b6-a5d3-4d29-afdc-400b1f252156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.550844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87b6b6-a5d3-4d29-afdc-400b1f252156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.551116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87b6b6-a5d3-4d29-afdc-400b1f252156 admin admin] PATH_INFO: `/v3/projects/270fe1f7b78b47779524e42a61fa813c/users/7f5739ad53854be19f6c4f439a9c0232/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.566726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87b6b6-a5d3-4d29-afdc-400b1f252156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270fe1f7b78b47779524e42a61fa813c, user_id=7f5739ad53854be19f6c4f439a9c0232, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.569601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87b6b6-a5d3-4d29-afdc-400b1f252156 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.583476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1007/1995] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:01 2022] PUT /identity/v3/projects/270fe1f7b78b47779524e42a61fa813c/users/7f5739ad53854be19f6c4f439a9c0232/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:01.587600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a7a7d-d299-43db-b00c-133e1fff4bd6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.598296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a7a7d-d299-43db-b00c-133e1fff4bd6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.668463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc147d-e260-4f18-9986-12a070f8d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.669207 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc147d-e260-4f18-9986-12a070f8d15c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.669486 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc147d-e260-4f18-9986-12a070f8d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.669757 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc147d-e260-4f18-9986-12a070f8d15c admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.670502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc147d-e260-4f18-9986-12a070f8d15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.674859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87b6b6-a5d3-4d29-afdc-400b1f252156 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.675085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc147d-e260-4f18-9986-12a070f8d15c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.676776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1a87b6b6-a5d3-4d29-afdc-400b1f252156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:01.686061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 989/1996] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:01.689825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc147d-e260-4f18-9986-12a070f8d15c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.696276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87b6b6-a5d3-4d29-afdc-400b1f252156 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.699839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc147d-e260-4f18-9986-12a070f8d15c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.701457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.702514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.702848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.703124 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] PATH_INFO: `/v3/projects/5ce6e94b122b4290878cad533e85b1bc` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.704328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ce6e94b122b4290878cad533e85b1bc)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.705764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52009635-9f7a-424c-924f-3c95891c3055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.706327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.706929 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52009635-9f7a-424c-924f-3c95891c3055 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.707227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52009635-9f7a-424c-924f-3c95891c3055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.707521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52009635-9f7a-424c-924f-3c95891c3055 admin admin] PATH_INFO: `/v3/projects/270fe1f7b78b47779524e42a61fa813c/users/7f5739ad53854be19f6c4f439a9c0232/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.709545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52009635-9f7a-424c-924f-3c95891c3055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270fe1f7b78b47779524e42a61fa813c, user_id=7f5739ad53854be19f6c4f439a9c0232, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.712399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52009635-9f7a-424c-924f-3c95891c3055 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.725336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 990/1997] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:01 2022] PUT /identity/v3/projects/270fe1f7b78b47779524e42a61fa813c/users/7f5739ad53854be19f6c4f439a9c0232/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:01.737191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007108c3-a602-4f58-a835-da59d5b30cea None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.737575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007108c3-a602-4f58-a835-da59d5b30cea None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.738233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007108c3-a602-4f58-a835-da59d5b30cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.773820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-007108c3-a602-4f58-a835-da59d5b30cea None None] MFA Rules not processed for user `7f5739ad53854be19f6c4f439a9c0232`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:01.775592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-007108c3-a602-4f58-a835-da59d5b30cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:01.836090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ce6e94b122b4290878cad533e85b1bc', 'request_id': 'req-3abca8b4-6c94-4f8c-a602-20f9303a2a33'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.852567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ce6e94b122b4290878cad533e85b1bc', 'request_id': 'req-3abca8b4-6c94-4f8c-a602-20f9303a2a33'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.876896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ce6e94b122b4290878cad533e85b1bc', 'request_id': 'req-3abca8b4-6c94-4f8c-a602-20f9303a2a33'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.904239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] The token cache is being invalidate because project 5ce6e94b122b4290878cad533e85b1bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:01.904532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.905253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3abca8b4-6c94-4f8c-a602-20f9303a2a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:01.908163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1008/1998] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:01 2022] DELETE /identity/v3/projects/5ce6e94b122b4290878cad533e85b1bc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:01.914560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b3e30-f795-4891-ad8b-73bc3970da71 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.915172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b3e30-f795-4891-ad8b-73bc3970da71 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.915584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b3e30-f795-4891-ad8b-73bc3970da71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.920126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 991/1999] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:01.948239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ea6b3e30-f795-4891-ad8b-73bc3970da71 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:01.950230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ea6b3e30-f795-4891-ad8b-73bc3970da71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:01.972145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007108c3-a602-4f58-a835-da59d5b30cea None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.977175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-007108c3-a602-4f58-a835-da59d5b30cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:01.993979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:02.010572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:02.031801 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1009/2000] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:02.043672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd2ad-aff2-4473-8c95-575799c9abd3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.044514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd2ad-aff2-4473-8c95-575799c9abd3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.044898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd2ad-aff2-4473-8c95-575799c9abd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.063275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007108c3-a602-4f58-a835-da59d5b30cea None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.069410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0adbd2ad-aff2-4473-8c95-575799c9abd3 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:02.070826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0adbd2ad-aff2-4473-8c95-575799c9abd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:02.079591 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1010/2001] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:02.084455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd2ad-aff2-4473-8c95-575799c9abd3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.097409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd2ad-aff2-4473-8c95-575799c9abd3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.102304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1a9d1-64e7-494f-aeb7-2ba0a231cbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.103096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1a9d1-64e7-494f-aeb7-2ba0a231cbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.103374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1a9d1-64e7-494f-aeb7-2ba0a231cbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.103642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1a9d1-64e7-494f-aeb7-2ba0a231cbe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.104376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1a9d1-64e7-494f-aeb7-2ba0a231cbe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:02.104686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1a9d1-64e7-494f-aeb7-2ba0a231cbe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.106340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1a9d1-64e7-494f-aeb7-2ba0a231cbe0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.123657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1011/2002] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:32:02.128539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1a9d1-64e7-494f-aeb7-2ba0a231cbe0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.136741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9be347-f180-45dd-ad41-168c9a3e8b1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.138288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9be347-f180-45dd-ad41-168c9a3e8b1b service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.138579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1a9d1-64e7-494f-aeb7-2ba0a231cbe0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.139002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9be347-f180-45dd-ad41-168c9a3e8b1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.139978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9be347-f180-45dd-ad41-168c9a3e8b1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.142400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6c9be347-f180-45dd-ad41-168c9a3e8b1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:02.143149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da9eb-44ab-4123-b10e-d5c78841a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.143810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da9eb-44ab-4123-b10e-d5c78841a2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.144103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da9eb-44ab-4123-b10e-d5c78841a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.144335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da9eb-44ab-4123-b10e-d5c78841a2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.145058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672da9eb-44ab-4123-b10e-d5c78841a2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.146938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672da9eb-44ab-4123-b10e-d5c78841a2d4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.174840 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1012/2003] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:02 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:02.178898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da9eb-44ab-4123-b10e-d5c78841a2d4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.210308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9be347-f180-45dd-ad41-168c9a3e8b1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.211826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9be347-f180-45dd-ad41-168c9a3e8b1b service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.221959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 992/2004] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:02.239315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da9eb-44ab-4123-b10e-d5c78841a2d4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.245167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c7991-9e2f-4be9-80b5-9e398da90c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.246084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c7991-9e2f-4be9-80b5-9e398da90c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.246401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c7991-9e2f-4be9-80b5-9e398da90c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.246649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c7991-9e2f-4be9-80b5-9e398da90c0f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.247406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c7991-9e2f-4be9-80b5-9e398da90c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.249474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c7991-9e2f-4be9-80b5-9e398da90c0f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.273030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1013/2005] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:02 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:02.274892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9be347-f180-45dd-ad41-168c9a3e8b1b service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.286219 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9be347-f180-45dd-ad41-168c9a3e8b1b service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.292897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49474c-2f8f-4dc9-b05b-c9c68d34371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.293960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49474c-2f8f-4dc9-b05b-c9c68d34371c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.294527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49474c-2f8f-4dc9-b05b-c9c68d34371c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.294527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49474c-2f8f-4dc9-b05b-c9c68d34371c admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.295506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49474c-2f8f-4dc9-b05b-c9c68d34371c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.297311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49474c-2f8f-4dc9-b05b-c9c68d34371c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.309433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 993/2006] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:02.312769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c7991-9e2f-4be9-80b5-9e398da90c0f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.314016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49474c-2f8f-4dc9-b05b-c9c68d34371c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.317306 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ba0c7991-9e2f-4be9-80b5-9e398da90c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:02.327071 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49474c-2f8f-4dc9-b05b-c9c68d34371c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.333033 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c91c4-aa77-47fa-95c2-d9879778c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.333858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c91c4-aa77-47fa-95c2-d9879778c90e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.334359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c91c4-aa77-47fa-95c2-d9879778c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.334721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c91c4-aa77-47fa-95c2-d9879778c90e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.335714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c91c4-aa77-47fa-95c2-d9879778c90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.337541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c91c4-aa77-47fa-95c2-d9879778c90e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.349288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 994/2007] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:02.353377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c91c4-aa77-47fa-95c2-d9879778c90e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.364823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c91c4-aa77-47fa-95c2-d9879778c90e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.369823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4042a-55e1-47c7-831c-f61a5adc2155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.370823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4042a-55e1-47c7-831c-f61a5adc2155 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.371318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4042a-55e1-47c7-831c-f61a5adc2155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.371713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4042a-55e1-47c7-831c-f61a5adc2155 admin admin] PATH_INFO: `/v3/projects/b708e888274c466f817c8765650943a1/users/d882951da637449ba71593f10c53be7b/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.382126 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c7991-9e2f-4be9-80b5-9e398da90c0f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.387209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a191-bffc-43ac-84c0-db76c55df36f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.387621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4042a-55e1-47c7-831c-f61a5adc2155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b708e888274c466f817c8765650943a1, user_id=d882951da637449ba71593f10c53be7b, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.387997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a191-bffc-43ac-84c0-db76c55df36f service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.388344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a191-bffc-43ac-84c0-db76c55df36f service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.388602 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a191-bffc-43ac-84c0-db76c55df36f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.390491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c415a191-bffc-43ac-84c0-db76c55df36f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:02.391002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4042a-55e1-47c7-831c-f61a5adc2155 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.410602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 995/2008] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:02 2022] PUT /identity/v3/projects/b708e888274c466f817c8765650943a1/users/d882951da637449ba71593f10c53be7b/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:02.422541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16025a8b-e8aa-4c9d-a312-87f6aabbb959 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.422919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16025a8b-e8aa-4c9d-a312-87f6aabbb959 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.423260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16025a8b-e8aa-4c9d-a312-87f6aabbb959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.447880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:02.453024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415a191-bffc-43ac-84c0-db76c55df36f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.453678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-16025a8b-e8aa-4c9d-a312-87f6aabbb959 None None] MFA Rules not processed for user `d882951da637449ba71593f10c53be7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:02.455108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-16025a8b-e8aa-4c9d-a312-87f6aabbb959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:02.455822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415a191-bffc-43ac-84c0-db76c55df36f service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.467471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1014/2009] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:02.473082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:02.532228 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 996/2010] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:02.544214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a191-bffc-43ac-84c0-db76c55df36f service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.545768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c415a191-bffc-43ac-84c0-db76c55df36f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:02.557370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a191-bffc-43ac-84c0-db76c55df36f service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.616547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c9a7-1d1a-474b-9fb2-718f93dc02b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.617350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c9a7-1d1a-474b-9fb2-718f93dc02b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.617950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c9a7-1d1a-474b-9fb2-718f93dc02b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.617950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c9a7-1d1a-474b-9fb2-718f93dc02b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.629596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c9a7-1d1a-474b-9fb2-718f93dc02b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.631262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c9a7-1d1a-474b-9fb2-718f93dc02b5 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.640261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1015/2011] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:12.528822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=19 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:12.636236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=29 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:14.912223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16025a8b-e8aa-4c9d-a312-87f6aabbb959 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:14.912726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-16025a8b-e8aa-4c9d-a312-87f6aabbb959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:14.984236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16025a8b-e8aa-4c9d-a312-87f6aabbb959 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:14.989087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:14.990967 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:14.991235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:14.991502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] PATH_INFO: `/v3/users/755c65ad4e294e48aa9e81aa7b54e192` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:14.994534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=755c65ad4e294e48aa9e81aa7b54e192)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:14.996017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:15.094961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '755c65ad4e294e48aa9e81aa7b54e192'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:15.116340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '755c65ad4e294e48aa9e81aa7b54e192'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:15.117390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '755c65ad4e294e48aa9e81aa7b54e192'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:15.118230 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '755c65ad4e294e48aa9e81aa7b54e192'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:15.130841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '755c65ad4e294e48aa9e81aa7b54e192'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:15.150986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 997/2012] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:14 2022] DELETE /identity/v3/users/755c65ad4e294e48aa9e81aa7b54e192 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:15.157472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6476d-f0e5-45a7-aa2f-fe9654c74815 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:15.158037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6476d-f0e5-45a7-aa2f-fe9654c74815 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:15.158037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6476d-f0e5-45a7-aa2f-fe9654c74815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:15.178474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-90d6476d-f0e5-45a7-aa2f-fe9654c74815 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:15.179834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-90d6476d-f0e5-45a7-aa2f-fe9654c74815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:15.246107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1016/2013] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:15.256454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:15.258045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:15.318087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668085f-1a67-4689-8d6a-5d83e8a1b638 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:15.322501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc657ac6-07d2-4d9d-a641-a6941da026bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:15.323178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc657ac6-07d2-4d9d-a641-a6941da026bc service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:15.323460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc657ac6-07d2-4d9d-a641-a6941da026bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:15.323735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc657ac6-07d2-4d9d-a641-a6941da026bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:15.334013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc657ac6-07d2-4d9d-a641-a6941da026bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:15.335383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc657ac6-07d2-4d9d-a641-a6941da026bc service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:15.350637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 998/2014] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:15.838804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6476d-f0e5-45a7-aa2f-fe9654c74815 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:15.840248 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-90d6476d-f0e5-45a7-aa2f-fe9654c74815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:15.853624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6476d-f0e5-45a7-aa2f-fe9654c74815 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:15.859696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:15.860601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:15.861088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:15.861193 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] PATH_INFO: `/v3/projects/7896b3de67f94529a525d26c7d09f64e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:15.862854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7896b3de67f94529a525d26c7d09f64e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:15.864734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:15.914693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7896b3de67f94529a525d26c7d09f64e', 'request_id': 'req-1b7d54fe-6b37-4810-9909-bcccb4088907'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:15.922850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7896b3de67f94529a525d26c7d09f64e', 'request_id': 'req-1b7d54fe-6b37-4810-9909-bcccb4088907'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:15.929632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7896b3de67f94529a525d26c7d09f64e', 'request_id': 'req-1b7d54fe-6b37-4810-9909-bcccb4088907'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:15.941269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] The token cache is being invalidate because project 7896b3de67f94529a525d26c7d09f64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:15.941557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:15.942230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:15.943826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1017/2015] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:15 2022] DELETE /identity/v3/projects/7896b3de67f94529a525d26c7d09f64e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:15.947872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc657ac6-07d2-4d9d-a641-a6941da026bc service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:15.957673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc657ac6-07d2-4d9d-a641-a6941da026bc service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:15.976337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:16.017760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665a36e-b05c-43bf-81d2-b99acc86e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:16.018612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665a36e-b05c-43bf-81d2-b99acc86e970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:16.019567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665a36e-b05c-43bf-81d2-b99acc86e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:16.019567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665a36e-b05c-43bf-81d2-b99acc86e970 admin admin] PATH_INFO: `/v3/users/7f5739ad53854be19f6c4f439a9c0232` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:16.021797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665a36e-b05c-43bf-81d2-b99acc86e970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f5739ad53854be19f6c4f439a9c0232)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:16.023780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665a36e-b05c-43bf-81d2-b99acc86e970 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:16.094905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4665a36e-b05c-43bf-81d2-b99acc86e970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f5739ad53854be19f6c4f439a9c0232'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:16.113572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4665a36e-b05c-43bf-81d2-b99acc86e970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f5739ad53854be19f6c4f439a9c0232'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:16.114503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4665a36e-b05c-43bf-81d2-b99acc86e970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f5739ad53854be19f6c4f439a9c0232'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:16.115262 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4665a36e-b05c-43bf-81d2-b99acc86e970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f5739ad53854be19f6c4f439a9c0232'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:16.125419 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4665a36e-b05c-43bf-81d2-b99acc86e970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f5739ad53854be19f6c4f439a9c0232'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:16.141082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 999/2016] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:15 2022] DELETE /identity/v3/users/7f5739ad53854be19f6c4f439a9c0232 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:16.517202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:16.518789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:16.533326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d54fe-6b37-4810-9909-bcccb4088907 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:16.597729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:16.598615 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:16.598897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:16.599173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] PATH_INFO: `/v3/projects/270fe1f7b78b47779524e42a61fa813c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:16.600358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270fe1f7b78b47779524e42a61fa813c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:16.602309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:16.635723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:16.654706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270fe1f7b78b47779524e42a61fa813c', 'request_id': 'req-9c751a2f-f398-4cbe-b1e3-46e4831c0236'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:16.664350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270fe1f7b78b47779524e42a61fa813c', 'request_id': 'req-9c751a2f-f398-4cbe-b1e3-46e4831c0236'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:16.671343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270fe1f7b78b47779524e42a61fa813c', 'request_id': 'req-9c751a2f-f398-4cbe-b1e3-46e4831c0236'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:16.684670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] The token cache is being invalidate because project 270fe1f7b78b47779524e42a61fa813c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:16.684977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:16.686306 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9c751a2f-f398-4cbe-b1e3-46e4831c0236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:16.687920 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1018/2017] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:16 2022] DELETE /identity/v3/projects/270fe1f7b78b47779524e42a61fa813c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:16.693728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22970-8f82-40bc-8e93-127c6dc41139 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:16.694026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22970-8f82-40bc-8e93-127c6dc41139 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:16.694317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22970-8f82-40bc-8e93-127c6dc41139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:16.713816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-67c22970-8f82-40bc-8e93-127c6dc41139 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:16.715037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-67c22970-8f82-40bc-8e93-127c6dc41139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:16.777763 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1000/2018] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:16.785443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae472c-100f-445c-91e2-1eb7e8a8c3fb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:16.785723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae472c-100f-445c-91e2-1eb7e8a8c3fb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:16.785997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae472c-100f-445c-91e2-1eb7e8a8c3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:16.804630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e8ae472c-100f-445c-91e2-1eb7e8a8c3fb None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:16.805952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e8ae472c-100f-445c-91e2-1eb7e8a8c3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:16.815883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1019/2019] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:16.820375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c22970-8f82-40bc-8e93-127c6dc41139 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:16.832152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c22970-8f82-40bc-8e93-127c6dc41139 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:16.837292 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35455787-f967-499e-9f25-32c8331385ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:16.838056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35455787-f967-499e-9f25-32c8331385ab admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:16.838332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35455787-f967-499e-9f25-32c8331385ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:16.838606 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35455787-f967-499e-9f25-32c8331385ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:16.839340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35455787-f967-499e-9f25-32c8331385ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:16.839647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35455787-f967-499e-9f25-32c8331385ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:16.841325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35455787-f967-499e-9f25-32c8331385ab admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:16.854907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1001/2020] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:16.860078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae472c-100f-445c-91e2-1eb7e8a8c3fb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:16.869962 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae472c-100f-445c-91e2-1eb7e8a8c3fb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:16.874760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281bcdd-715e-4e31-a394-93ec709ef399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:16.875420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281bcdd-715e-4e31-a394-93ec709ef399 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:16.875695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281bcdd-715e-4e31-a394-93ec709ef399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:16.875952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281bcdd-715e-4e31-a394-93ec709ef399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:16.876658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281bcdd-715e-4e31-a394-93ec709ef399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:16.878610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281bcdd-715e-4e31-a394-93ec709ef399 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:16.906532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1020/2021] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:16 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:16.910756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35455787-f967-499e-9f25-32c8331385ab admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:16.921670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35455787-f967-499e-9f25-32c8331385ab admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:16.949245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:16.982658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78116781-53f3-4b33-8236-d6e52c1d78be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:16.983411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78116781-53f3-4b33-8236-d6e52c1d78be admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:16.983688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78116781-53f3-4b33-8236-d6e52c1d78be admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:16.983956 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78116781-53f3-4b33-8236-d6e52c1d78be admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:16.984653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78116781-53f3-4b33-8236-d6e52c1d78be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:16.987346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78116781-53f3-4b33-8236-d6e52c1d78be admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:17.009504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1002/2022] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:16 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:17.013851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281bcdd-715e-4e31-a394-93ec709ef399 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:17.024736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281bcdd-715e-4e31-a394-93ec709ef399 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:17.029934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e920c4-97e5-44f7-b44d-525ab3b92c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:17.030856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e920c4-97e5-44f7-b44d-525ab3b92c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.031215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e920c4-97e5-44f7-b44d-525ab3b92c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.031414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e920c4-97e5-44f7-b44d-525ab3b92c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.032246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e920c4-97e5-44f7-b44d-525ab3b92c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:17.033976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e920c4-97e5-44f7-b44d-525ab3b92c7d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:17.058315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1021/2023] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:32:17.064110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78116781-53f3-4b33-8236-d6e52c1d78be admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:17.075102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78116781-53f3-4b33-8236-d6e52c1d78be admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:17.080155 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a5f80-1af7-43fb-bdb6-ee6b22d80c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:17.080856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a5f80-1af7-43fb-bdb6-ee6b22d80c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.081188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a5f80-1af7-43fb-bdb6-ee6b22d80c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.081462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a5f80-1af7-43fb-bdb6-ee6b22d80c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.082214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a5f80-1af7-43fb-bdb6-ee6b22d80c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:17.083813 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a5f80-1af7-43fb-bdb6-ee6b22d80c13 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:17.095996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1003/2024] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:17.099757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e920c4-97e5-44f7-b44d-525ab3b92c7d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:17.110698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e920c4-97e5-44f7-b44d-525ab3b92c7d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:17.116169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd08d5-c8c3-48c6-bcaa-df38e60e31fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:17.117221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd08d5-c8c3-48c6-bcaa-df38e60e31fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.117568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd08d5-c8c3-48c6-bcaa-df38e60e31fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.117902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd08d5-c8c3-48c6-bcaa-df38e60e31fd admin admin] PATH_INFO: `/v3/projects/09b45ea33978405ea3561dd300471806/users/8eac405f522f4006b5ab0a81bde32ff3/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.135018 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd08d5-c8c3-48c6-bcaa-df38e60e31fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b45ea33978405ea3561dd300471806, user_id=8eac405f522f4006b5ab0a81bde32ff3, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:17.138169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd08d5-c8c3-48c6-bcaa-df38e60e31fd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:17.165879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1022/2025] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:17 2022] PUT /identity/v3/projects/09b45ea33978405ea3561dd300471806/users/8eac405f522f4006b5ab0a81bde32ff3/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:17.167486 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7f69a-e8ae-49f5-8499-3feef836d1ae None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.167970 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7f69a-e8ae-49f5-8499-3feef836d1ae None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.168638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7f69a-e8ae-49f5-8499-3feef836d1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.221061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a4c7f69a-e8ae-49f5-8499-3feef836d1ae None None] MFA Rules not processed for user `8eac405f522f4006b5ab0a81bde32ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:17.222359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a4c7f69a-e8ae-49f5-8499-3feef836d1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:17.294231 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1004/2026] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:17.299247 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd08d5-c8c3-48c6-bcaa-df38e60e31fd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:17.362284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd08d5-c8c3-48c6-bcaa-df38e60e31fd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:17.367609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b925dbc-2b8c-46a3-8344-3634de2f195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:17.368355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b925dbc-2b8c-46a3-8344-3634de2f195a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.368641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b925dbc-2b8c-46a3-8344-3634de2f195a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.368933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b925dbc-2b8c-46a3-8344-3634de2f195a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.369743 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b925dbc-2b8c-46a3-8344-3634de2f195a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:17.371737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b925dbc-2b8c-46a3-8344-3634de2f195a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:17.401393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1023/2027] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:17 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:17.406169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7f69a-e8ae-49f5-8499-3feef836d1ae None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:17.418824 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7f69a-e8ae-49f5-8499-3feef836d1ae None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:17.487596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b6848-d096-47ce-beda-54805b307d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:17.490629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b6848-d096-47ce-beda-54805b307d25 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.490629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b6848-d096-47ce-beda-54805b307d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.490629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b6848-d096-47ce-beda-54805b307d25 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.490629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b6848-d096-47ce-beda-54805b307d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:17.492727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b6848-d096-47ce-beda-54805b307d25 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:17.520893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1005/2028] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:17 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:17.525107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b925dbc-2b8c-46a3-8344-3634de2f195a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:17.538370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b925dbc-2b8c-46a3-8344-3634de2f195a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:17.543346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d3291-e4a1-4d1e-b0a1-a856e71a39ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:17.544026 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3291-e4a1-4d1e-b0a1-a856e71a39ef admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.544306 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3291-e4a1-4d1e-b0a1-a856e71a39ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.544576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3291-e4a1-4d1e-b0a1-a856e71a39ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.545430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d3291-e4a1-4d1e-b0a1-a856e71a39ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:17.547039 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d3291-e4a1-4d1e-b0a1-a856e71a39ef admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:17.558170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1024/2029] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:17.562468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b6848-d096-47ce-beda-54805b307d25 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:17.573299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b6848-d096-47ce-beda-54805b307d25 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:17.578225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e325e6e-88ed-4182-86cd-d2337895c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:17.579164 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325e6e-88ed-4182-86cd-d2337895c765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.579442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325e6e-88ed-4182-86cd-d2337895c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.579712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325e6e-88ed-4182-86cd-d2337895c765 admin admin] PATH_INFO: `/v3/projects/855dd0d58c144c88af1612b90064aef4/users/4864909de2e4405c88bc90dfc87a8c9f/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.598335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e325e6e-88ed-4182-86cd-d2337895c765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855dd0d58c144c88af1612b90064aef4, user_id=4864909de2e4405c88bc90dfc87a8c9f, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:17.601185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e325e6e-88ed-4182-86cd-d2337895c765 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:17.619855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1006/2030] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:17 2022] PUT /identity/v3/projects/855dd0d58c144c88af1612b90064aef4/users/4864909de2e4405c88bc90dfc87a8c9f/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:17.624398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d3291-e4a1-4d1e-b0a1-a856e71a39ef admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:17.635359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d3291-e4a1-4d1e-b0a1-a856e71a39ef admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:17.657349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:17.700455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a3221-dd35-44f9-afac-4ba1d1c5fb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:17.701121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3221-dd35-44f9-afac-4ba1d1c5fb4a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.701426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3221-dd35-44f9-afac-4ba1d1c5fb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.701697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3221-dd35-44f9-afac-4ba1d1c5fb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.702452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a3221-dd35-44f9-afac-4ba1d1c5fb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:17.704047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a3221-dd35-44f9-afac-4ba1d1c5fb4a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:17.713723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1025/2031] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:32:17.719438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e325e6e-88ed-4182-86cd-d2337895c765 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:17.726031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:17.731593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e325e6e-88ed-4182-86cd-d2337895c765 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:17.737319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a677d66-1938-4b16-b3c6-4106cec263e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:17.738660 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677d66-1938-4b16-b3c6-4106cec263e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.738930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677d66-1938-4b16-b3c6-4106cec263e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.739197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677d66-1938-4b16-b3c6-4106cec263e3 admin admin] PATH_INFO: `/v3/projects/855dd0d58c144c88af1612b90064aef4/users/4864909de2e4405c88bc90dfc87a8c9f/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.741233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a677d66-1938-4b16-b3c6-4106cec263e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855dd0d58c144c88af1612b90064aef4, user_id=4864909de2e4405c88bc90dfc87a8c9f, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:17.743878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a677d66-1938-4b16-b3c6-4106cec263e3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:17.754238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1007/2032] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:17 2022] PUT /identity/v3/projects/855dd0d58c144c88af1612b90064aef4/users/4864909de2e4405c88bc90dfc87a8c9f/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:17.764723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ec90f-b560-498c-844c-2f541e0b8a4d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.765013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ec90f-b560-498c-844c-2f541e0b8a4d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.765378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ec90f-b560-498c-844c-2f541e0b8a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.792181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1f4ec90f-b560-498c-844c-2f541e0b8a4d None None] MFA Rules not processed for user `4864909de2e4405c88bc90dfc87a8c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:17.793482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f4ec90f-b560-498c-844c-2f541e0b8a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:17.869987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1026/2033] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:17.881754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a677d66-1938-4b16-b3c6-4106cec263e3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:17.883589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6a677d66-1938-4b16-b3c6-4106cec263e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:17.943067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a677d66-1938-4b16-b3c6-4106cec263e3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:17.947001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fba44-9dc3-4bf3-8dd8-44ebc3122394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:17.947650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fba44-9dc3-4bf3-8dd8-44ebc3122394 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.947978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fba44-9dc3-4bf3-8dd8-44ebc3122394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.948257 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fba44-9dc3-4bf3-8dd8-44ebc3122394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.957576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fba44-9dc3-4bf3-8dd8-44ebc3122394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:17.958922 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fba44-9dc3-4bf3-8dd8-44ebc3122394 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:17.968368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1008/2034] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:18.395804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ec90f-b560-498c-844c-2f541e0b8a4d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:18.464428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ec90f-b560-498c-844c-2f541e0b8a4d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:18.471145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:18.472499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:18.472784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:18.473091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] PATH_INFO: `/v3/users/8eac405f522f4006b5ab0a81bde32ff3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:18.474413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eac405f522f4006b5ab0a81bde32ff3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:18.476634 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:18.545698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eac405f522f4006b5ab0a81bde32ff3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:18.547796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:18.577903 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eac405f522f4006b5ab0a81bde32ff3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:18.579166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eac405f522f4006b5ab0a81bde32ff3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:18.592386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eac405f522f4006b5ab0a81bde32ff3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:18.604091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eac405f522f4006b5ab0a81bde32ff3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:18.611580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1027/2035] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:18 2022] DELETE /identity/v3/users/8eac405f522f4006b5ab0a81bde32ff3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:18.616810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeb0a2-77a5-4858-8250-8ade77d2d23b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:18.617399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeb0a2-77a5-4858-8250-8ade77d2d23b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:18.617722 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeb0a2-77a5-4858-8250-8ade77d2d23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:18.647302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8bfeb0a2-77a5-4858-8250-8ade77d2d23b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:18.648510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8bfeb0a2-77a5-4858-8250-8ade77d2d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:18.737531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1009/2036] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:18.749497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:18.753203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:18.835238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893de376-096a-4329-a5b8-0e903bd3c230 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:18.840248 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f4de4-19a6-41cb-b103-de903cc1b4ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:18.841128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f4de4-19a6-41cb-b103-de903cc1b4ec service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:18.841413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f4de4-19a6-41cb-b103-de903cc1b4ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:18.841713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f4de4-19a6-41cb-b103-de903cc1b4ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:18.851979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f4de4-19a6-41cb-b103-de903cc1b4ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:18.853504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f4de4-19a6-41cb-b103-de903cc1b4ec service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:18.864728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1028/2037] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:19.029608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeb0a2-77a5-4858-8250-8ade77d2d23b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:19.032038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8bfeb0a2-77a5-4858-8250-8ade77d2d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:19.047641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeb0a2-77a5-4858-8250-8ade77d2d23b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:19.055253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:19.056796 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:19.057210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:19.057945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] PATH_INFO: `/v3/users/3e81c19861ea4122b20240ae04e8fa19` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:19.059802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e81c19861ea4122b20240ae04e8fa19)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:19.064007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:19.133637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e81c19861ea4122b20240ae04e8fa19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.149289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e81c19861ea4122b20240ae04e8fa19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.150152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e81c19861ea4122b20240ae04e8fa19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.150754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e81c19861ea4122b20240ae04e8fa19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.160596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e81c19861ea4122b20240ae04e8fa19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.180538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1010/2038] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:19 2022] DELETE /identity/v3/users/3e81c19861ea4122b20240ae04e8fa19 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:19.185960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56be2-5bcb-4611-8147-a4a2c14a8af5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:19.186416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56be2-5bcb-4611-8147-a4a2c14a8af5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:19.186859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56be2-5bcb-4611-8147-a4a2c14a8af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:19.208728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4be56be2-5bcb-4611-8147-a4a2c14a8af5 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:19.210231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4be56be2-5bcb-4611-8147-a4a2c14a8af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:19.289029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1029/2039] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:19.314107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:19.315700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:19.335184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:19.335314 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be56be2-5bcb-4611-8147-a4a2c14a8af5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:19.336759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4be56be2-5bcb-4611-8147-a4a2c14a8af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:19.352919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be56be2-5bcb-4611-8147-a4a2c14a8af5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:19.370960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:19.373317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:19.373750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:19.374023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] PATH_INFO: `/v3/projects/09b45ea33978405ea3561dd300471806` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:19.376440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b45ea33978405ea3561dd300471806)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:19.379392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:19.438935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5e2c2-bc8e-447c-8384-15dbae5b60ca admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:19.457563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b45ea33978405ea3561dd300471806', 'request_id': 'req-9a3c7f6d-383f-46f8-836b-ba6218772fb4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.489658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b45ea33978405ea3561dd300471806', 'request_id': 'req-9a3c7f6d-383f-46f8-836b-ba6218772fb4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.496672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:19.509759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b45ea33978405ea3561dd300471806', 'request_id': 'req-9a3c7f6d-383f-46f8-836b-ba6218772fb4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.526745 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88ceef-751d-4f1a-ad56-92c47aae8da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:19.527609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ceef-751d-4f1a-ad56-92c47aae8da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:19.527951 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ceef-751d-4f1a-ad56-92c47aae8da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:19.528284 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ceef-751d-4f1a-ad56-92c47aae8da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:19.539738 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] The token cache is being invalidate because project 09b45ea33978405ea3561dd300471806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:19.540030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.541429 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.543494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1030/2040] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:19 2022] DELETE /identity/v3/projects/09b45ea33978405ea3561dd300471806 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:19.550234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:19.551793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:19.622960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88ceef-751d-4f1a-ad56-92c47aae8da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:19.624744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88ceef-751d-4f1a-ad56-92c47aae8da6 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:19.627458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c7f6d-383f-46f8-836b-ba6218772fb4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:19.632306 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208a1f3-59f6-4555-a449-c6bea64f207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:19.633865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a1f3-59f6-4555-a449-c6bea64f207b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:19.634143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a1f3-59f6-4555-a449-c6bea64f207b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:19.634737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a1f3-59f6-4555-a449-c6bea64f207b admin admin] PATH_INFO: `/v3/users/4864909de2e4405c88bc90dfc87a8c9f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:19.635658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208a1f3-59f6-4555-a449-c6bea64f207b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4864909de2e4405c88bc90dfc87a8c9f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:19.637749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1011/2041] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:19.637896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208a1f3-59f6-4555-a449-c6bea64f207b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:19.703022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2208a1f3-59f6-4555-a449-c6bea64f207b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4864909de2e4405c88bc90dfc87a8c9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.734210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2208a1f3-59f6-4555-a449-c6bea64f207b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4864909de2e4405c88bc90dfc87a8c9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.735080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2208a1f3-59f6-4555-a449-c6bea64f207b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4864909de2e4405c88bc90dfc87a8c9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.749374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2208a1f3-59f6-4555-a449-c6bea64f207b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4864909de2e4405c88bc90dfc87a8c9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.761407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2208a1f3-59f6-4555-a449-c6bea64f207b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4864909de2e4405c88bc90dfc87a8c9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:19.779260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1031/2042] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:19 2022] DELETE /identity/v3/users/4864909de2e4405c88bc90dfc87a8c9f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:19.844916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88ceef-751d-4f1a-ad56-92c47aae8da6 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:19.846972 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9f88ceef-751d-4f1a-ad56-92c47aae8da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:19.863408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88ceef-751d-4f1a-ad56-92c47aae8da6 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:19.994109 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:19.995515 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:19.995878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:19.996166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] PATH_INFO: `/v3/users/d14b072a699240678077d45ad2c65d91` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:19.997754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14b072a699240678077d45ad2c65d91)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:20.000018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:20.014212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:20.065110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14b072a699240678077d45ad2c65d91'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.085207 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14b072a699240678077d45ad2c65d91'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.086938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14b072a699240678077d45ad2c65d91'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.087691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14b072a699240678077d45ad2c65d91'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.100319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14b072a699240678077d45ad2c65d91'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.118445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1012/2043] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:19 2022] DELETE /identity/v3/users/d14b072a699240678077d45ad2c65d91 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:20.123173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e482c8-d4f4-4f9c-8367-ca8fe1c74a43 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.123655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e482c8-d4f4-4f9c-8367-ca8fe1c74a43 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.123938 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e482c8-d4f4-4f9c-8367-ca8fe1c74a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.142339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-39e482c8-d4f4-4f9c-8367-ca8fe1c74a43 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:20.143573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-39e482c8-d4f4-4f9c-8367-ca8fe1c74a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.218496 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1032/2044] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:20.218840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:20.220418 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.228067 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e482c8-d4f4-4f9c-8367-ca8fe1c74a43 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:20.229633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-39e482c8-d4f4-4f9c-8367-ca8fe1c74a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.246092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:20.255523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6f63a-a0a1-4c79-b37f-1451d4d27fa3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:20.265401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:20.266321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.266606 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.266882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] PATH_INFO: `/v3/projects/e511d14a407e45e4a5fabae3b94f7240` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.268864 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e511d14a407e45e4a5fabae3b94f7240)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:20.272414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:20.307208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e482c8-d4f4-4f9c-8367-ca8fe1c74a43 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:20.311882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1bd99-ff23-42c2-b0e7-0993a390355c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:20.313078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1bd99-ff23-42c2-b0e7-0993a390355c service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.313078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1bd99-ff23-42c2-b0e7-0993a390355c service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.313284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1bd99-ff23-42c2-b0e7-0993a390355c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.325333 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1bd99-ff23-42c2-b0e7-0993a390355c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:20.326965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1bd99-ff23-42c2-b0e7-0993a390355c service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:20.334707 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e511d14a407e45e4a5fabae3b94f7240', 'request_id': 'req-de522469-56e7-44cd-99be-f00b35f3feea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.339232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1033/2045] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:32:20.340120 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1bd99-ff23-42c2-b0e7-0993a390355c service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:20.342258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b6e1bd99-ff23-42c2-b0e7-0993a390355c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.352553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e511d14a407e45e4a5fabae3b94f7240', 'request_id': 'req-de522469-56e7-44cd-99be-f00b35f3feea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.356458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1bd99-ff23-42c2-b0e7-0993a390355c service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:20.360730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e511d14a407e45e4a5fabae3b94f7240', 'request_id': 'req-de522469-56e7-44cd-99be-f00b35f3feea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.375269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] The token cache is being invalidate because project e511d14a407e45e4a5fabae3b94f7240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:20.375802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.376549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.378762 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1013/2046] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:20 2022] DELETE /identity/v3/projects/e511d14a407e45e4a5fabae3b94f7240 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:20.382719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:20.384162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.427481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:20.428364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.428799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.429109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] PATH_INFO: `/v3/projects/855dd0d58c144c88af1612b90064aef4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.430442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855dd0d58c144c88af1612b90064aef4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:20.432372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:20.456338 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522469-56e7-44cd-99be-f00b35f3feea admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:20.463384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:20.464327 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.464676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.464886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] PATH_INFO: `/v3/users/fb2153eca1dd4bf89fb83ca1a857186d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.466925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2153eca1dd4bf89fb83ca1a857186d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:20.468917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:20.487447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:20.494367 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855dd0d58c144c88af1612b90064aef4', 'request_id': 'req-3514e9d1-8997-4b21-8f54-01e461d2e8d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.508861 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855dd0d58c144c88af1612b90064aef4', 'request_id': 'req-3514e9d1-8997-4b21-8f54-01e461d2e8d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.515845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855dd0d58c144c88af1612b90064aef4', 'request_id': 'req-3514e9d1-8997-4b21-8f54-01e461d2e8d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.528627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] The token cache is being invalidate because project 855dd0d58c144c88af1612b90064aef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:20.528876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.529436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2153eca1dd4bf89fb83ca1a857186d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.529653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3514e9d1-8997-4b21-8f54-01e461d2e8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.531505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1034/2047] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:20 2022] DELETE /identity/v3/projects/855dd0d58c144c88af1612b90064aef4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:20.539522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfbe1e-5318-4dfa-86f4-69672feff6ad None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.539782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfbe1e-5318-4dfa-86f4-69672feff6ad None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.540062 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfbe1e-5318-4dfa-86f4-69672feff6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.549259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2153eca1dd4bf89fb83ca1a857186d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.550426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2153eca1dd4bf89fb83ca1a857186d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.550942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2153eca1dd4bf89fb83ca1a857186d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.561316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2153eca1dd4bf89fb83ca1a857186d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.561489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-eedfbe1e-5318-4dfa-86f4-69672feff6ad None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:20.562626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eedfbe1e-5318-4dfa-86f4-69672feff6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.578641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1014/2048] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:20 2022] DELETE /identity/v3/users/fb2153eca1dd4bf89fb83ca1a857186d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:20.624239 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:20.625825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.626110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:20.654482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1035/2049] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:20.663491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca27446-432d-47ac-a5f8-8244ced1b93b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.663785 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca27446-432d-47ac-a5f8-8244ced1b93b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.664059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca27446-432d-47ac-a5f8-8244ced1b93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.683484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-aca27446-432d-47ac-a5f8-8244ced1b93b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:20.684995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aca27446-432d-47ac-a5f8-8244ced1b93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.726831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0d2cb-a0e1-4cad-b839-2e71d1d8b118 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:20.731855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:20.733005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.733588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.733896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] PATH_INFO: `/v3/projects/fb6c87546c424fde9c5ba84b67c516fa` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.735158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6c87546c424fde9c5ba84b67c516fa)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:20.737318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:20.756627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1036/2050] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:20.761217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca27446-432d-47ac-a5f8-8244ced1b93b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:20.771576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca27446-432d-47ac-a5f8-8244ced1b93b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:20.776650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6718-4d57-4e63-977b-22af6a131e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:20.777450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6718-4d57-4e63-977b-22af6a131e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.777797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6718-4d57-4e63-977b-22af6a131e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.778165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6718-4d57-4e63-977b-22af6a131e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.778967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda6718-4d57-4e63-977b-22af6a131e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:20.779406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda6718-4d57-4e63-977b-22af6a131e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:20.781022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda6718-4d57-4e63-977b-22af6a131e86 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:20.795139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1037/2051] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:32:20.799399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6718-4d57-4e63-977b-22af6a131e86 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:20.808849 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6c87546c424fde9c5ba84b67c516fa', 'request_id': 'req-2530340e-7407-495a-9e1a-6dc5028b7bcd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.811149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6718-4d57-4e63-977b-22af6a131e86 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:20.819484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6c87546c424fde9c5ba84b67c516fa', 'request_id': 'req-2530340e-7407-495a-9e1a-6dc5028b7bcd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.831209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6c87546c424fde9c5ba84b67c516fa', 'request_id': 'req-2530340e-7407-495a-9e1a-6dc5028b7bcd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.845627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] The token cache is being invalidate because project fb6c87546c424fde9c5ba84b67c516fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:20.846051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.846822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2530340e-7407-495a-9e1a-6dc5028b7bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:20.848540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1015/2052] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:20 2022] DELETE /identity/v3/projects/fb6c87546c424fde9c5ba84b67c516fa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:20.853721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449de4c8-611c-4823-811f-d5ce2cedf463 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.854010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449de4c8-611c-4823-811f-d5ce2cedf463 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.854336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449de4c8-611c-4823-811f-d5ce2cedf463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.879051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-449de4c8-611c-4823-811f-d5ce2cedf463 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:20.881247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-449de4c8-611c-4823-811f-d5ce2cedf463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.888292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff717-abad-419e-a306-6782b3f6776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:20.889097 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff717-abad-419e-a306-6782b3f6776a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.889387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff717-abad-419e-a306-6782b3f6776a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.889693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff717-abad-419e-a306-6782b3f6776a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.890436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ff717-abad-419e-a306-6782b3f6776a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:20.892413 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ff717-abad-419e-a306-6782b3f6776a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:20.904238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:20.923585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1038/2053] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:20 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:20.927641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff717-abad-419e-a306-6782b3f6776a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:20.929284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-862ff717-abad-419e-a306-6782b3f6776a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.953302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1016/2054] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:20.954478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449de4c8-611c-4823-811f-d5ce2cedf463 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:20.955906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-449de4c8-611c-4823-811f-d5ce2cedf463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.967544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449de4c8-611c-4823-811f-d5ce2cedf463 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:20.989956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:20.994316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff717-abad-419e-a306-6782b3f6776a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.002617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.003510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.003791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.004066 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] PATH_INFO: `/v3/projects/3c4b2d271a38448f97fa1c6bd4088fc5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.005448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4b2d271a38448f97fa1c6bd4088fc5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.007376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.030317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d7138-1e84-40e5-b525-417e8142513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.030804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d7138-1e84-40e5-b525-417e8142513e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.031222 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d7138-1e84-40e5-b525-417e8142513e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.031498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d7138-1e84-40e5-b525-417e8142513e admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.032196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d7138-1e84-40e5-b525-417e8142513e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.034188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d7138-1e84-40e5-b525-417e8142513e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.061202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1017/2055] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:20 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:21.061202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122afae2-d54b-421e-aa81-25d3265f6cfa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.061202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122afae2-d54b-421e-aa81-25d3265f6cfa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.061202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122afae2-d54b-421e-aa81-25d3265f6cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.063350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4b2d271a38448f97fa1c6bd4088fc5', 'request_id': 'req-564513e7-8db7-47fe-bc6f-244d08fea39b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:21.072523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4b2d271a38448f97fa1c6bd4088fc5', 'request_id': 'req-564513e7-8db7-47fe-bc6f-244d08fea39b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:21.081028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-122afae2-d54b-421e-aa81-25d3265f6cfa None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:21.081533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4b2d271a38448f97fa1c6bd4088fc5', 'request_id': 'req-564513e7-8db7-47fe-bc6f-244d08fea39b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:21.082232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-122afae2-d54b-421e-aa81-25d3265f6cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:21.094478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] The token cache is being invalidate because project 3c4b2d271a38448f97fa1c6bd4088fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:21.094762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:21.095426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:21.098225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1039/2056] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:20 2022] DELETE /identity/v3/projects/3c4b2d271a38448f97fa1c6bd4088fc5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:21.098225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.099652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:21.161747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1018/2057] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:21.163923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb4fa9-3591-43ac-99a1-d2e69cc35c1f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.165560 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb4fa9-3591-43ac-99a1-d2e69cc35c1f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.166447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb4fa9-3591-43ac-99a1-d2e69cc35c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.176022 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564513e7-8db7-47fe-bc6f-244d08fea39b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.181558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab723-a3c1-4da6-8d80-a8fbb1a0d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.182951 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab723-a3c1-4da6-8d80-a8fbb1a0d464 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.183183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab723-a3c1-4da6-8d80-a8fbb1a0d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.183652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab723-a3c1-4da6-8d80-a8fbb1a0d464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.184515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aab723-a3c1-4da6-8d80-a8fbb1a0d464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.190185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aab723-a3c1-4da6-8d80-a8fbb1a0d464 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.196219 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2ffb4fa9-3591-43ac-99a1-d2e69cc35c1f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:21.197490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2ffb4fa9-3591-43ac-99a1-d2e69cc35c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:21.222454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1040/2058] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:21.229006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1019/2059] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:21.229006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb4fa9-3591-43ac-99a1-d2e69cc35c1f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.231339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab723-a3c1-4da6-8d80-a8fbb1a0d464 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.240304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb4fa9-3591-43ac-99a1-d2e69cc35c1f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.246268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7583e6-7818-432f-9e77-786de881b1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.246958 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7583e6-7818-432f-9e77-786de881b1ea admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.247972 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7583e6-7818-432f-9e77-786de881b1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.247972 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7583e6-7818-432f-9e77-786de881b1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.248437 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7583e6-7818-432f-9e77-786de881b1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.248741 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab723-a3c1-4da6-8d80-a8fbb1a0d464 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.250149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7583e6-7818-432f-9e77-786de881b1ea admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.257127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de7987-dade-4d53-81df-6956198d83d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.258094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de7987-dade-4d53-81df-6956198d83d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.258638 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de7987-dade-4d53-81df-6956198d83d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.259103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de7987-dade-4d53-81df-6956198d83d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.260052 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de7987-dade-4d53-81df-6956198d83d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:21.260584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de7987-dade-4d53-81df-6956198d83d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.261738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1020/2060] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:32:21.263083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509cf03-b71e-43e0-be02-bd35cf135cd9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.263353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de7987-dade-4d53-81df-6956198d83d3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.263538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509cf03-b71e-43e0-be02-bd35cf135cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.263761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509cf03-b71e-43e0-be02-bd35cf135cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.277607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1041/2061] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:21.278872 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de7987-dade-4d53-81df-6956198d83d3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.283945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a509cf03-b71e-43e0-be02-bd35cf135cd9 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:21.285253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a509cf03-b71e-43e0-be02-bd35cf135cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:21.290460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de7987-dade-4d53-81df-6956198d83d3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.293459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1021/2062] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:21.296885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509cf03-b71e-43e0-be02-bd35cf135cd9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.303043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b4ce4-3942-4239-b90c-6643b8a1d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.303906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509cf03-b71e-43e0-be02-bd35cf135cd9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.304438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4ce4-3942-4239-b90c-6643b8a1d810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.304983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4ce4-3942-4239-b90c-6643b8a1d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.305453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4ce4-3942-4239-b90c-6643b8a1d810 admin admin] PATH_INFO: `/v3/projects/dcab6311df80472aa2c169f29f24fcaa/users/48c089fdc258454ab9d38aa40da5f727/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.308447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e377b3-35c1-4424-82af-f76f7f953c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.309056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e377b3-35c1-4424-82af-f76f7f953c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.309335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e377b3-35c1-4424-82af-f76f7f953c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.309602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e377b3-35c1-4424-82af-f76f7f953c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.310918 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e377b3-35c1-4424-82af-f76f7f953c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.312294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e377b3-35c1-4424-82af-f76f7f953c4c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.324691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b4ce4-3942-4239-b90c-6643b8a1d810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcab6311df80472aa2c169f29f24fcaa, user_id=48c089fdc258454ab9d38aa40da5f727, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.328465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b4ce4-3942-4239-b90c-6643b8a1d810 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.342822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1022/2063] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:21.343699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e377b3-35c1-4424-82af-f76f7f953c4c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.344238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1042/2064] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:21 2022] PUT /identity/v3/projects/dcab6311df80472aa2c169f29f24fcaa/users/48c089fdc258454ab9d38aa40da5f727/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:21.347647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b4ce4-3942-4239-b90c-6643b8a1d810 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.362000 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:21.407875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:21.422880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e377b3-35c1-4424-82af-f76f7f953c4c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.427930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bd692-93df-45c8-97ef-5e8f0a2ccdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.428607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bd692-93df-45c8-97ef-5e8f0a2ccdfe admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.428746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b4ce4-3942-4239-b90c-6643b8a1d810 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.428882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bd692-93df-45c8-97ef-5e8f0a2ccdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.429186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bd692-93df-45c8-97ef-5e8f0a2ccdfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.429949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bd692-93df-45c8-97ef-5e8f0a2ccdfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:21.430258 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bd692-93df-45c8-97ef-5e8f0a2ccdfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.431840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bd692-93df-45c8-97ef-5e8f0a2ccdfe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.434113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0a24a-0522-4eb5-9089-5616c80937c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.434874 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a24a-0522-4eb5-9089-5616c80937c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.435158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a24a-0522-4eb5-9089-5616c80937c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.435509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a24a-0522-4eb5-9089-5616c80937c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.436366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0a24a-0522-4eb5-9089-5616c80937c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.438326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0a24a-0522-4eb5-9089-5616c80937c5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.454715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1023/2065] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:21.456381 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9c83-a6c0-401e-9867-f7709e39e02c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.456784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9c83-a6c0-401e-9867-f7709e39e02c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.457391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9c83-a6c0-401e-9867-f7709e39e02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.470013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1043/2066] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:21.470013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0a24a-0522-4eb5-9089-5616c80937c5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.479425 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0a24a-0522-4eb5-9089-5616c80937c5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.484304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59044ab0-31ff-482c-9675-5273d51df5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.485023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044ab0-31ff-482c-9675-5273d51df5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.485302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044ab0-31ff-482c-9675-5273d51df5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.485578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044ab0-31ff-482c-9675-5273d51df5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.486272 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59044ab0-31ff-482c-9675-5273d51df5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.487160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-17ee9c83-a6c0-401e-9867-f7709e39e02c None None] MFA Rules not processed for user `48c089fdc258454ab9d38aa40da5f727`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:21.488526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59044ab0-31ff-482c-9675-5273d51df5c2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.488740 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-17ee9c83-a6c0-401e-9867-f7709e39e02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:21.519694 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1044/2067] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:21.520709 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59044ab0-31ff-482c-9675-5273d51df5c2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.557446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1024/2068] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:21.561551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee9c83-a6c0-401e-9867-f7709e39e02c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.568697 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee9c83-a6c0-401e-9867-f7709e39e02c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.595874 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59044ab0-31ff-482c-9675-5273d51df5c2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.601343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17e1e-a4f1-4bcb-80a9-ebfed68ddea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.602783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17e1e-a4f1-4bcb-80a9-ebfed68ddea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.603069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17e1e-a4f1-4bcb-80a9-ebfed68ddea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.603346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17e1e-a4f1-4bcb-80a9-ebfed68ddea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.604087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c17e1e-a4f1-4bcb-80a9-ebfed68ddea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.605833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c17e1e-a4f1-4bcb-80a9-ebfed68ddea5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.617017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1045/2069] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:21.617963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17e1e-a4f1-4bcb-80a9-ebfed68ddea5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.627988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17e1e-a4f1-4bcb-80a9-ebfed68ddea5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.629893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa612f-cc3f-48d9-812b-77cc6360096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.630579 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa612f-cc3f-48d9-812b-77cc6360096a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.630861 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa612f-cc3f-48d9-812b-77cc6360096a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.631132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa612f-cc3f-48d9-812b-77cc6360096a admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.631832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa612f-cc3f-48d9-812b-77cc6360096a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.632792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81068b5f-360e-41b4-80b7-1b191a23c02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.633483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81068b5f-360e-41b4-80b7-1b191a23c02a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.633768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81068b5f-360e-41b4-80b7-1b191a23c02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.633888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa612f-cc3f-48d9-812b-77cc6360096a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.634040 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81068b5f-360e-41b4-80b7-1b191a23c02a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.634737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81068b5f-360e-41b4-80b7-1b191a23c02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.636630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81068b5f-360e-41b4-80b7-1b191a23c02a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.657598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1025/2070] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:21.657598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa612f-cc3f-48d9-812b-77cc6360096a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.664524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1046/2071] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:21.665161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa612f-cc3f-48d9-812b-77cc6360096a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.665377 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81068b5f-360e-41b4-80b7-1b191a23c02a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.681908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:21.721897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269168d-f13b-4660-92d4-4d7e4411ce55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.722576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269168d-f13b-4660-92d4-4d7e4411ce55 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.722856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269168d-f13b-4660-92d4-4d7e4411ce55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.723134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269168d-f13b-4660-92d4-4d7e4411ce55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.723872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269168d-f13b-4660-92d4-4d7e4411ce55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.725540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269168d-f13b-4660-92d4-4d7e4411ce55 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.728380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81068b5f-360e-41b4-80b7-1b191a23c02a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.733008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42b3a6-ea35-4817-b8d8-57ea9c089062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.733672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42b3a6-ea35-4817-b8d8-57ea9c089062 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.733949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42b3a6-ea35-4817-b8d8-57ea9c089062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.734217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42b3a6-ea35-4817-b8d8-57ea9c089062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.734977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42b3a6-ea35-4817-b8d8-57ea9c089062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.739169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1026/2072] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:21.739169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269168d-f13b-4660-92d4-4d7e4411ce55 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.739361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42b3a6-ea35-4817-b8d8-57ea9c089062 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.747491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1047/2073] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:21.748086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269168d-f13b-4660-92d4-4d7e4411ce55 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.748227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42b3a6-ea35-4817-b8d8-57ea9c089062 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.753975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd780d-036f-40d2-8d68-7f79e753fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.755206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd780d-036f-40d2-8d68-7f79e753fc52 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.755491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd780d-036f-40d2-8d68-7f79e753fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.755941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd780d-036f-40d2-8d68-7f79e753fc52 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.756649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd780d-036f-40d2-8d68-7f79e753fc52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.757987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42b3a6-ea35-4817-b8d8-57ea9c089062 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.758597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd780d-036f-40d2-8d68-7f79e753fc52 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.762499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff036c6-8a1a-485f-88da-201209362d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.763409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff036c6-8a1a-485f-88da-201209362d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.763725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff036c6-8a1a-485f-88da-201209362d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.763998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff036c6-8a1a-485f-88da-201209362d7c admin admin] PATH_INFO: `/v3/projects/90d3bf726a8248058cbb95795b454dd1/users/e23fcb16b89d4fe6a6f03466f8d0d575/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.781135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff036c6-8a1a-485f-88da-201209362d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d3bf726a8248058cbb95795b454dd1, user_id=e23fcb16b89d4fe6a6f03466f8d0d575, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.782155 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1027/2074] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:21.782957 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd780d-036f-40d2-8d68-7f79e753fc52 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.783905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff036c6-8a1a-485f-88da-201209362d7c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.795320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:21.796168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd780d-036f-40d2-8d68-7f79e753fc52 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.800464 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1048/2075] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:21 2022] PUT /identity/v3/projects/90d3bf726a8248058cbb95795b454dd1/users/e23fcb16b89d4fe6a6f03466f8d0d575/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:21.801606 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff036c6-8a1a-485f-88da-201209362d7c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.857436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f151561-eed6-4c6e-b25b-7050fa419a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.858035 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f151561-eed6-4c6e-b25b-7050fa419a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.858334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f151561-eed6-4c6e-b25b-7050fa419a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.858591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f151561-eed6-4c6e-b25b-7050fa419a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.859357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f151561-eed6-4c6e-b25b-7050fa419a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.861051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f151561-eed6-4c6e-b25b-7050fa419a30 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.871524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1028/2076] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:21.872907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7de8c-8f43-45fe-aaad-46be83546c44 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.873215 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7de8c-8f43-45fe-aaad-46be83546c44 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.873490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7de8c-8f43-45fe-aaad-46be83546c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.873969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff036c6-8a1a-485f-88da-201209362d7c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.878717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28625f-04c5-4e30-976e-3fceab3adda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.879520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28625f-04c5-4e30-976e-3fceab3adda7 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.879790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28625f-04c5-4e30-976e-3fceab3adda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.880067 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28625f-04c5-4e30-976e-3fceab3adda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.880803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28625f-04c5-4e30-976e-3fceab3adda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.882484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28625f-04c5-4e30-976e-3fceab3adda7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.890790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-67e7de8c-8f43-45fe-aaad-46be83546c44 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:21.891986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-67e7de8c-8f43-45fe-aaad-46be83546c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:21.892892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1049/2077] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:21.893706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28625f-04c5-4e30-976e-3fceab3adda7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.899826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1029/2078] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:21.899826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7de8c-8f43-45fe-aaad-46be83546c44 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.906420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28625f-04c5-4e30-976e-3fceab3adda7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.910149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7de8c-8f43-45fe-aaad-46be83546c44 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.911163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6411a-3a2f-4e6b-b2c5-774669656fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.912059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6411a-3a2f-4e6b-b2c5-774669656fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.912369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6411a-3a2f-4e6b-b2c5-774669656fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.912649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6411a-3a2f-4e6b-b2c5-774669656fee admin admin] PATH_INFO: `/v3/projects/f2f8a5bf55f34941a7bb78a3e34ff2e7/users/0222876fab9343d8935948431235c021/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.914746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0ec16-597b-4de7-a273-9005f71521f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.915621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0ec16-597b-4de7-a273-9005f71521f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.915906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0ec16-597b-4de7-a273-9005f71521f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.916180 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0ec16-597b-4de7-a273-9005f71521f1 admin admin] PATH_INFO: `/v3/projects/299e856f6ad44beaa9a0d640c8aee3f4/users/973522ec33114352ac9618720a151d60/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.927786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6411a-3a2f-4e6b-b2c5-774669656fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f8a5bf55f34941a7bb78a3e34ff2e7, user_id=0222876fab9343d8935948431235c021, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.930462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6411a-3a2f-4e6b-b2c5-774669656fee admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.930830 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0ec16-597b-4de7-a273-9005f71521f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299e856f6ad44beaa9a0d640c8aee3f4, user_id=973522ec33114352ac9618720a151d60, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.933560 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0ec16-597b-4de7-a273-9005f71521f1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.945456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1050/2079] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:21 2022] PUT /identity/v3/projects/f2f8a5bf55f34941a7bb78a3e34ff2e7/users/0222876fab9343d8935948431235c021/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:21.946446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6411a-3a2f-4e6b-b2c5-774669656fee admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.948088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ecc6411a-3a2f-4e6b-b2c5-774669656fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:21.956390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1030/2080] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:21 2022] PUT /identity/v3/projects/299e856f6ad44beaa9a0d640c8aee3f4/users/973522ec33114352ac9618720a151d60/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:21.957751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e563ac-728a-49e1-a16f-603a0b22fac6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.958042 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e563ac-728a-49e1-a16f-603a0b22fac6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.958667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e563ac-728a-49e1-a16f-603a0b22fac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.984256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-18e563ac-728a-49e1-a16f-603a0b22fac6 None None] MFA Rules not processed for user `0222876fab9343d8935948431235c021`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:21.985481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-18e563ac-728a-49e1-a16f-603a0b22fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:22.002930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6411a-3a2f-4e6b-b2c5-774669656fee admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:22.041995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:22.053063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9048b75-33be-4811-84a4-f2bf92ab6841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:22.053427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1031/2081] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:22.053777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9048b75-33be-4811-84a4-f2bf92ab6841 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.054063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9048b75-33be-4811-84a4-f2bf92ab6841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.054297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e563ac-728a-49e1-a16f-603a0b22fac6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:22.054399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9048b75-33be-4811-84a4-f2bf92ab6841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.098572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:22.119379 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9048b75-33be-4811-84a4-f2bf92ab6841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:22.120283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e563ac-728a-49e1-a16f-603a0b22fac6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:22.120797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9048b75-33be-4811-84a4-f2bf92ab6841 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:22.125347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd12aa-97e8-4b3a-9cff-de648f30fe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:22.126017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd12aa-97e8-4b3a-9cff-de648f30fe00 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.126299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd12aa-97e8-4b3a-9cff-de648f30fe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.126568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd12aa-97e8-4b3a-9cff-de648f30fe00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.127297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd12aa-97e8-4b3a-9cff-de648f30fe00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:22.128937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd12aa-97e8-4b3a-9cff-de648f30fe00 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:22.130381 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1051/2082] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:22.131239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9048b75-33be-4811-84a4-f2bf92ab6841 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:22.140990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1032/2083] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:22.141139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9048b75-33be-4811-84a4-f2bf92ab6841 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:22.143801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd12aa-97e8-4b3a-9cff-de648f30fe00 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:22.145548 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a13d79-abd1-4eeb-81e5-8654db942f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:22.146208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a13d79-abd1-4eeb-81e5-8654db942f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.146487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a13d79-abd1-4eeb-81e5-8654db942f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.146760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a13d79-abd1-4eeb-81e5-8654db942f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.147458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a13d79-abd1-4eeb-81e5-8654db942f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:22.149393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a13d79-abd1-4eeb-81e5-8654db942f40 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:22.154552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd12aa-97e8-4b3a-9cff-de648f30fe00 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:22.161382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb67fa-34a6-4423-b846-6ca9ee2242b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:22.162825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb67fa-34a6-4423-b846-6ca9ee2242b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.163100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb67fa-34a6-4423-b846-6ca9ee2242b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.163383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb67fa-34a6-4423-b846-6ca9ee2242b2 admin admin] PATH_INFO: `/v3/projects/299e856f6ad44beaa9a0d640c8aee3f4/users/973522ec33114352ac9618720a151d60/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.166340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb67fa-34a6-4423-b846-6ca9ee2242b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299e856f6ad44beaa9a0d640c8aee3f4, user_id=973522ec33114352ac9618720a151d60, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:22.170363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb67fa-34a6-4423-b846-6ca9ee2242b2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:22.184777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1052/2084] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:22 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:22.184949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1033/2085] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:22 2022] PUT /identity/v3/projects/299e856f6ad44beaa9a0d640c8aee3f4/users/973522ec33114352ac9618720a151d60/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:22.186445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a13d79-abd1-4eeb-81e5-8654db942f40 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:22.193884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6586b-30d4-4778-b27b-4ef4d99129d8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.194169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6586b-30d4-4778-b27b-4ef4d99129d8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.194850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6586b-30d4-4778-b27b-4ef4d99129d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.229815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-99f6586b-30d4-4778-b27b-4ef4d99129d8 None None] MFA Rules not processed for user `973522ec33114352ac9618720a151d60`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:22.231155 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-99f6586b-30d4-4778-b27b-4ef4d99129d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:22.274946 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a13d79-abd1-4eeb-81e5-8654db942f40 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:22.279969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6192bec-0f19-4091-92b3-78dcb16cd892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:22.280677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6192bec-0f19-4091-92b3-78dcb16cd892 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.281506 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6192bec-0f19-4091-92b3-78dcb16cd892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.281796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6192bec-0f19-4091-92b3-78dcb16cd892 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.282621 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6192bec-0f19-4091-92b3-78dcb16cd892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:22.284578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6192bec-0f19-4091-92b3-78dcb16cd892 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:22.306849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1053/2086] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:22 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:22.311030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6192bec-0f19-4091-92b3-78dcb16cd892 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:22.322440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6192bec-0f19-4091-92b3-78dcb16cd892 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:22.327277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b700ff4-b9e1-4a8d-b242-ceb81c4e94d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:22.327950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b700ff4-b9e1-4a8d-b242-ceb81c4e94d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.328223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b700ff4-b9e1-4a8d-b242-ceb81c4e94d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.328516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b700ff4-b9e1-4a8d-b242-ceb81c4e94d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.329482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b700ff4-b9e1-4a8d-b242-ceb81c4e94d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:22.331096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b700ff4-b9e1-4a8d-b242-ceb81c4e94d0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:22.336154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1034/2087] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:22.342426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1054/2088] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:22.347638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6586b-30d4-4778-b27b-4ef4d99129d8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:22.351319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b700ff4-b9e1-4a8d-b242-ceb81c4e94d0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:22.353133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9b700ff4-b9e1-4a8d-b242-ceb81c4e94d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:22.361180 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6586b-30d4-4778-b27b-4ef4d99129d8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:22.367261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28e39f-7250-4087-b234-5e213ca388d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:22.368404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28e39f-7250-4087-b234-5e213ca388d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.368745 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28e39f-7250-4087-b234-5e213ca388d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.369122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28e39f-7250-4087-b234-5e213ca388d4 admin admin] PATH_INFO: `/v3/projects/74ed459d75ac41f6ae995c834d5b311c/users/57871f0ca7ba42be97210048b5eae93f/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.387952 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28e39f-7250-4087-b234-5e213ca388d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ed459d75ac41f6ae995c834d5b311c, user_id=57871f0ca7ba42be97210048b5eae93f, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:22.391062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28e39f-7250-4087-b234-5e213ca388d4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:22.411260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1035/2089] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:22 2022] PUT /identity/v3/projects/74ed459d75ac41f6ae995c834d5b311c/users/57871f0ca7ba42be97210048b5eae93f/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:22.412321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28e39f-7250-4087-b234-5e213ca388d4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:22.413926 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b700ff4-b9e1-4a8d-b242-ceb81c4e94d0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:22.465157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:22.492803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a39d9c-b6b9-4df5-ba35-231d612c78a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:22.493516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a39d9c-b6b9-4df5-ba35-231d612c78a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.493800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a39d9c-b6b9-4df5-ba35-231d612c78a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.494078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a39d9c-b6b9-4df5-ba35-231d612c78a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.498810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:22.507464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28e39f-7250-4087-b234-5e213ca388d4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:22.515440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89628975-bfce-4bca-a3c9-a44878a01dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:22.516403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89628975-bfce-4bca-a3c9-a44878a01dea admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.516859 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89628975-bfce-4bca-a3c9-a44878a01dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.517330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89628975-bfce-4bca-a3c9-a44878a01dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.518538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89628975-bfce-4bca-a3c9-a44878a01dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:22.520666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89628975-bfce-4bca-a3c9-a44878a01dea admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:22.534817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1036/2090] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:22.539075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89628975-bfce-4bca-a3c9-a44878a01dea admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:22.551506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89628975-bfce-4bca-a3c9-a44878a01dea admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:22.557313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc180556-15d3-4fc7-b213-39bb6bb2634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:22.558950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180556-15d3-4fc7-b213-39bb6bb2634c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.559286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180556-15d3-4fc7-b213-39bb6bb2634c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.559623 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180556-15d3-4fc7-b213-39bb6bb2634c admin admin] PATH_INFO: `/v3/projects/74ed459d75ac41f6ae995c834d5b311c/users/57871f0ca7ba42be97210048b5eae93f/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.559780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a39d9c-b6b9-4df5-ba35-231d612c78a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:22.561465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a39d9c-b6b9-4df5-ba35-231d612c78a4 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:22.562213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc180556-15d3-4fc7-b213-39bb6bb2634c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ed459d75ac41f6ae995c834d5b311c, user_id=57871f0ca7ba42be97210048b5eae93f, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:22.566281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc180556-15d3-4fc7-b213-39bb6bb2634c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:22.578952 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1037/2091] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:22 2022] PUT /identity/v3/projects/74ed459d75ac41f6ae995c834d5b311c/users/57871f0ca7ba42be97210048b5eae93f/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:22.585079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1055/2092] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:22.591450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72521a-c127-4fa1-afed-f2ac83bc42d9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.591840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72521a-c127-4fa1-afed-f2ac83bc42d9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.592178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72521a-c127-4fa1-afed-f2ac83bc42d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.627935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-da72521a-c127-4fa1-afed-f2ac83bc42d9 None None] MFA Rules not processed for user `57871f0ca7ba42be97210048b5eae93f`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:22.629284 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-da72521a-c127-4fa1-afed-f2ac83bc42d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:22.727609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1038/2093] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:22.728975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a39d9c-b6b9-4df5-ba35-231d612c78a4 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:22.731347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58a39d9c-b6b9-4df5-ba35-231d612c78a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:22.748390 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a39d9c-b6b9-4df5-ba35-231d612c78a4 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:22.842841 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024460df-d9eb-4239-a4dd-f6f16a0ee5d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:22.844028 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024460df-d9eb-4239-a4dd-f6f16a0ee5d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:22.844508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024460df-d9eb-4239-a4dd-f6f16a0ee5d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:22.845063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024460df-d9eb-4239-a4dd-f6f16a0ee5d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:22.865436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024460df-d9eb-4239-a4dd-f6f16a0ee5d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:22.867171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024460df-d9eb-4239-a4dd-f6f16a0ee5d9 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:22.879066 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1056/2094] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:22.972419 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72521a-c127-4fa1-afed-f2ac83bc42d9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:23.072875 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72521a-c127-4fa1-afed-f2ac83bc42d9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:23.078159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:23.079111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:23.079449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:23.079782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] PATH_INFO: `/v3/users/0222876fab9343d8935948431235c021` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:23.081089 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0222876fab9343d8935948431235c021)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:23.083174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:23.137807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0222876fab9343d8935948431235c021'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:23.139423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:23.153938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0222876fab9343d8935948431235c021'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:23.154795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0222876fab9343d8935948431235c021'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:23.155476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0222876fab9343d8935948431235c021'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:23.164094 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0222876fab9343d8935948431235c021'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:23.181991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1039/2095] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:22 2022] DELETE /identity/v3/users/0222876fab9343d8935948431235c021 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:23.186320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e4f5-dde9-4738-a48a-f0a7d1a14b82 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:23.186669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e4f5-dde9-4738-a48a-f0a7d1a14b82 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:23.187056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e4f5-dde9-4738-a48a-f0a7d1a14b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:23.205143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8980e4f5-dde9-4738-a48a-f0a7d1a14b82 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:23.206466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8980e4f5-dde9-4738-a48a-f0a7d1a14b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:23.273425 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1057/2096] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:23.285223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:23.286937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:23.355558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037057a-a7a5-4e9d-82ef-92f08e226b05 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:23.359278 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb041c77-5b90-4513-b5a4-5ec9ee7391ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:23.360066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb041c77-5b90-4513-b5a4-5ec9ee7391ef service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:23.360353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb041c77-5b90-4513-b5a4-5ec9ee7391ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:23.360775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb041c77-5b90-4513-b5a4-5ec9ee7391ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:23.373588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb041c77-5b90-4513-b5a4-5ec9ee7391ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:23.375331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb041c77-5b90-4513-b5a4-5ec9ee7391ef service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:23.385615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1040/2097] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:23.850846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980e4f5-dde9-4738-a48a-f0a7d1a14b82 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:23.858048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8980e4f5-dde9-4738-a48a-f0a7d1a14b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:23.913546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980e4f5-dde9-4738-a48a-f0a7d1a14b82 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:23.919096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:23.920911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:23.920911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:23.921156 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] PATH_INFO: `/v3/projects/f2f8a5bf55f34941a7bb78a3e34ff2e7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:23.922647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f8a5bf55f34941a7bb78a3e34ff2e7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:23.925465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:24.013230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:24.019893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f8a5bf55f34941a7bb78a3e34ff2e7', 'request_id': 'req-58df4d8d-3394-482c-8efe-007b68adf246'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:24.037396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f8a5bf55f34941a7bb78a3e34ff2e7', 'request_id': 'req-58df4d8d-3394-482c-8efe-007b68adf246'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:24.046638 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f8a5bf55f34941a7bb78a3e34ff2e7', 'request_id': 'req-58df4d8d-3394-482c-8efe-007b68adf246'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:24.075355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] The token cache is being invalidate because project f2f8a5bf55f34941a7bb78a3e34ff2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:24.075651 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:24.079095 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:24.096437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1058/2098] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:23 2022] DELETE /identity/v3/projects/f2f8a5bf55f34941a7bb78a3e34ff2e7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:24.100539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb041c77-5b90-4513-b5a4-5ec9ee7391ef service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:24.111528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb041c77-5b90-4513-b5a4-5ec9ee7391ef service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:24.184099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab330024-cd74-4298-b7c4-e753f0ca9c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:24.185015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330024-cd74-4298-b7c4-e753f0ca9c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:24.185352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330024-cd74-4298-b7c4-e753f0ca9c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:24.185633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330024-cd74-4298-b7c4-e753f0ca9c19 admin admin] PATH_INFO: `/v3/users/57871f0ca7ba42be97210048b5eae93f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:24.186849 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab330024-cd74-4298-b7c4-e753f0ca9c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57871f0ca7ba42be97210048b5eae93f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:24.188793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab330024-cd74-4298-b7c4-e753f0ca9c19 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:24.240631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ab330024-cd74-4298-b7c4-e753f0ca9c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57871f0ca7ba42be97210048b5eae93f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:24.256032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ab330024-cd74-4298-b7c4-e753f0ca9c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57871f0ca7ba42be97210048b5eae93f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:24.256765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ab330024-cd74-4298-b7c4-e753f0ca9c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57871f0ca7ba42be97210048b5eae93f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:24.257380 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ab330024-cd74-4298-b7c4-e753f0ca9c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57871f0ca7ba42be97210048b5eae93f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:24.261512 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:24.267510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ab330024-cd74-4298-b7c4-e753f0ca9c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57871f0ca7ba42be97210048b5eae93f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:24.281825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1041/2099] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:24 2022] DELETE /identity/v3/users/57871f0ca7ba42be97210048b5eae93f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:24.795070 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:24.798928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:24.839474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4d8d-3394-482c-8efe-007b68adf246 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:24.913102 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:24.914344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:24.914719 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:24.915333 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] PATH_INFO: `/v3/projects/74ed459d75ac41f6ae995c834d5b311c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:24.916909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ed459d75ac41f6ae995c834d5b311c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:24.920426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:24.990822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ed459d75ac41f6ae995c834d5b311c', 'request_id': 'req-59ad5c76-b64a-4557-942b-c21c1828ea1b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:25.001724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ed459d75ac41f6ae995c834d5b311c', 'request_id': 'req-59ad5c76-b64a-4557-942b-c21c1828ea1b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:25.010622 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ed459d75ac41f6ae995c834d5b311c', 'request_id': 'req-59ad5c76-b64a-4557-942b-c21c1828ea1b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:25.035320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] The token cache is being invalidate because project 74ed459d75ac41f6ae995c834d5b311c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:25.035926 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:25.037134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-59ad5c76-b64a-4557-942b-c21c1828ea1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:25.039292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1059/2100] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:24 2022] DELETE /identity/v3/projects/74ed459d75ac41f6ae995c834d5b311c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:25.045995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb72a8e-49e8-4996-8f29-56556c7a2a2e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:25.046504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb72a8e-49e8-4996-8f29-56556c7a2a2e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:25.046989 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb72a8e-49e8-4996-8f29-56556c7a2a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:25.068196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fdb72a8e-49e8-4996-8f29-56556c7a2a2e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:25.069384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fdb72a8e-49e8-4996-8f29-56556c7a2a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:25.171677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f24a63-8b56-4a4d-8d3e-d8ff944737dc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:25.171836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f24a63-8b56-4a4d-8d3e-d8ff944737dc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:25.172012 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1042/2101] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:25.172264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f24a63-8b56-4a4d-8d3e-d8ff944737dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:25.214104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b2f24a63-8b56-4a4d-8d3e-d8ff944737dc None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:25.215421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b2f24a63-8b56-4a4d-8d3e-d8ff944737dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:25.239492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1060/2102] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:25.240612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb72a8e-49e8-4996-8f29-56556c7a2a2e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:25.252825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb72a8e-49e8-4996-8f29-56556c7a2a2e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:25.268000 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781aa19-82f6-4119-b23a-5c953dc57a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:25.268692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781aa19-82f6-4119-b23a-5c953dc57a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:25.269087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781aa19-82f6-4119-b23a-5c953dc57a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:25.269414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781aa19-82f6-4119-b23a-5c953dc57a23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:25.270227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781aa19-82f6-4119-b23a-5c953dc57a23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:25.270597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781aa19-82f6-4119-b23a-5c953dc57a23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:25.275524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781aa19-82f6-4119-b23a-5c953dc57a23 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:25.305783 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1043/2103] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:25.310252 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f24a63-8b56-4a4d-8d3e-d8ff944737dc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:25.329616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f24a63-8b56-4a4d-8d3e-d8ff944737dc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:25.338525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938d9d5-375f-4124-bd14-5baf3ac88e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:25.339295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938d9d5-375f-4124-bd14-5baf3ac88e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:25.339476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938d9d5-375f-4124-bd14-5baf3ac88e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:25.339754 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938d9d5-375f-4124-bd14-5baf3ac88e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:25.340502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938d9d5-375f-4124-bd14-5baf3ac88e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:25.342904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938d9d5-375f-4124-bd14-5baf3ac88e91 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:25.412880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1061/2104] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:25 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:25.413862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781aa19-82f6-4119-b23a-5c953dc57a23 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:25.426789 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781aa19-82f6-4119-b23a-5c953dc57a23 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:25.501745 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2c39e-43cd-468b-818e-ca44607979c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:25.502684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c39e-43cd-468b-818e-ca44607979c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:25.503066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c39e-43cd-468b-818e-ca44607979c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:25.513686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c39e-43cd-468b-818e-ca44607979c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:25.514826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2c39e-43cd-468b-818e-ca44607979c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:25.517881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2c39e-43cd-468b-818e-ca44607979c3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:25.568886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1044/2105] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:25 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:25.570232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938d9d5-375f-4124-bd14-5baf3ac88e91 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:25.582953 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938d9d5-375f-4124-bd14-5baf3ac88e91 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:25.596454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a76b4-65ee-4326-86e5-e3b09ba90a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:25.597456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a76b4-65ee-4326-86e5-e3b09ba90a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:25.597878 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a76b4-65ee-4326-86e5-e3b09ba90a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:25.598300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a76b4-65ee-4326-86e5-e3b09ba90a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:25.599194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a76b4-65ee-4326-86e5-e3b09ba90a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:25.601047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a76b4-65ee-4326-86e5-e3b09ba90a91 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:25.629905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1062/2106] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:25.634463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2c39e-43cd-468b-818e-ca44607979c3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:25.653506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2c39e-43cd-468b-818e-ca44607979c3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:25.668667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb598d12-c587-46c2-921f-c1f0b02b6657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:25.670611 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb598d12-c587-46c2-921f-c1f0b02b6657 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:25.671383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb598d12-c587-46c2-921f-c1f0b02b6657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:25.671775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb598d12-c587-46c2-921f-c1f0b02b6657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:25.676173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb598d12-c587-46c2-921f-c1f0b02b6657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:25.678631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb598d12-c587-46c2-921f-c1f0b02b6657 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:25.709832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1045/2107] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:25.714134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a76b4-65ee-4326-86e5-e3b09ba90a91 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:25.731594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a76b4-65ee-4326-86e5-e3b09ba90a91 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:25.748027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e5c2e-fe1c-4728-a5f9-e3761040ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:25.749228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5c2e-fe1c-4728-a5f9-e3761040ddff admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:25.749516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5c2e-fe1c-4728-a5f9-e3761040ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:25.749800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5c2e-fe1c-4728-a5f9-e3761040ddff admin admin] PATH_INFO: `/v3/projects/96dc90a038ea4243a7ec7f6b6c2c7360/users/dff0d09de95f4d568cb1033213036d5a/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:25.798130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e5c2e-fe1c-4728-a5f9-e3761040ddff admin admin] RBAC: Authorizing `identity:create_grant(project_id=96dc90a038ea4243a7ec7f6b6c2c7360, user_id=dff0d09de95f4d568cb1033213036d5a, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:25.801488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e5c2e-fe1c-4728-a5f9-e3761040ddff admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:25.831512 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:25.842053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1063/2108] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:25 2022] PUT /identity/v3/projects/96dc90a038ea4243a7ec7f6b6c2c7360/users/dff0d09de95f4d568cb1033213036d5a/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:25.854949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395069-9fa7-4a8a-adac-aeca8873d508 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:25.855245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395069-9fa7-4a8a-adac-aeca8873d508 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:25.855635 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395069-9fa7-4a8a-adac-aeca8873d508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:25.908376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7c395069-9fa7-4a8a-adac-aeca8873d508 None None] MFA Rules not processed for user `dff0d09de95f4d568cb1033213036d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:25.909699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7c395069-9fa7-4a8a-adac-aeca8873d508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:26.017923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:26.065471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1046/2109] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:26.069766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e5c2e-fe1c-4728-a5f9-e3761040ddff admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:26.172134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e5c2e-fe1c-4728-a5f9-e3761040ddff admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:26.179699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3d4aa-56b1-41fc-845f-2c8427e7b1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:26.181088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d4aa-56b1-41fc-845f-2c8427e7b1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:26.181547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d4aa-56b1-41fc-845f-2c8427e7b1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:26.181994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d4aa-56b1-41fc-845f-2c8427e7b1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:26.182982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3d4aa-56b1-41fc-845f-2c8427e7b1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:26.185590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3d4aa-56b1-41fc-845f-2c8427e7b1a8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:26.239936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1064/2110] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:26 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:26.245049 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c395069-9fa7-4a8a-adac-aeca8873d508 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:26.274259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c395069-9fa7-4a8a-adac-aeca8873d508 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:26.389663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64f840-8100-497f-b922-ad61fd5e9529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:26.391331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f840-8100-497f-b922-ad61fd5e9529 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:26.391671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f840-8100-497f-b922-ad61fd5e9529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:26.392359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f840-8100-497f-b922-ad61fd5e9529 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:26.393180 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64f840-8100-497f-b922-ad61fd5e9529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:26.395293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64f840-8100-497f-b922-ad61fd5e9529 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:26.432382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1047/2111] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:26 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:26.438338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3d4aa-56b1-41fc-845f-2c8427e7b1a8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:26.454731 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3d4aa-56b1-41fc-845f-2c8427e7b1a8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:26.468833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5631-eeda-4ea2-a6cc-3a14c411d8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:26.469798 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5631-eeda-4ea2-a6cc-3a14c411d8ad admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:26.474935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5631-eeda-4ea2-a6cc-3a14c411d8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:26.475187 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5631-eeda-4ea2-a6cc-3a14c411d8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:26.476362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e5631-eeda-4ea2-a6cc-3a14c411d8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:26.478324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e5631-eeda-4ea2-a6cc-3a14c411d8ad admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:26.502144 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1065/2112] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:26.507057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64f840-8100-497f-b922-ad61fd5e9529 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:26.524094 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64f840-8100-497f-b922-ad61fd5e9529 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:26.538908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6c999-85d8-4df1-8040-cdf4e70d1597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:26.539960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6c999-85d8-4df1-8040-cdf4e70d1597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:26.540316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6c999-85d8-4df1-8040-cdf4e70d1597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:26.541110 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6c999-85d8-4df1-8040-cdf4e70d1597 admin admin] PATH_INFO: `/v3/projects/01eb56a277cf4014ad7f76687707388b/users/f26e0fb38cfc4676b0f9f4bc5bea9f85/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:26.569518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6c999-85d8-4df1-8040-cdf4e70d1597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01eb56a277cf4014ad7f76687707388b, user_id=f26e0fb38cfc4676b0f9f4bc5bea9f85, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:26.573480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6c999-85d8-4df1-8040-cdf4e70d1597 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:26.609543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5631-eeda-4ea2-a6cc-3a14c411d8ad admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:26.611988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-333e5631-eeda-4ea2-a6cc-3a14c411d8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:26.620602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1048/2113] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:26 2022] PUT /identity/v3/projects/01eb56a277cf4014ad7f76687707388b/users/f26e0fb38cfc4676b0f9f4bc5bea9f85/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:26.624420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6c999-85d8-4df1-8040-cdf4e70d1597 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:26.663645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5631-eeda-4ea2-a6cc-3a14c411d8ad admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:26.717753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6c999-85d8-4df1-8040-cdf4e70d1597 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:26.727618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cea04-922d-484c-9f84-3028d07abe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:26.732201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cea04-922d-484c-9f84-3028d07abe79 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:26.732201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cea04-922d-484c-9f84-3028d07abe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:26.732487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cea04-922d-484c-9f84-3028d07abe79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:26.733471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cea04-922d-484c-9f84-3028d07abe79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:26.735443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cea04-922d-484c-9f84-3028d07abe79 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:26.755750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1049/2114] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:26.758436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cea04-922d-484c-9f84-3028d07abe79 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:26.790052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cea04-922d-484c-9f84-3028d07abe79 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:26.795939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb1a44-aecd-4638-8322-1dfc3f1184ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:26.796892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1a44-aecd-4638-8322-1dfc3f1184ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:26.797225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1a44-aecd-4638-8322-1dfc3f1184ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:26.797654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1a44-aecd-4638-8322-1dfc3f1184ee admin admin] PATH_INFO: `/v3/projects/01eb56a277cf4014ad7f76687707388b/users/f26e0fb38cfc4676b0f9f4bc5bea9f85/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:26.804765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb1a44-aecd-4638-8322-1dfc3f1184ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=01eb56a277cf4014ad7f76687707388b, user_id=f26e0fb38cfc4676b0f9f4bc5bea9f85, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:26.834617 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb1a44-aecd-4638-8322-1dfc3f1184ee admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:26.848213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1050/2115] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:26 2022] PUT /identity/v3/projects/01eb56a277cf4014ad7f76687707388b/users/f26e0fb38cfc4676b0f9f4bc5bea9f85/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:26.857112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fbe26-f993-487d-9b6c-26f3a2836558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:26.857112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fbe26-f993-487d-9b6c-26f3a2836558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:26.857112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fbe26-f993-487d-9b6c-26f3a2836558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:26.857112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fbe26-f993-487d-9b6c-26f3a2836558 admin admin] PATH_INFO: `/v3/users/48c089fdc258454ab9d38aa40da5f727` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:26.857611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fbe26-f993-487d-9b6c-26f3a2836558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c089fdc258454ab9d38aa40da5f727)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:26.857611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fbe26-f993-487d-9b6c-26f3a2836558 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:26.861812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e73e4-bf6a-4367-958e-36e71db6efaa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:26.862395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e73e4-bf6a-4367-958e-36e71db6efaa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:26.863193 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e73e4-bf6a-4367-958e-36e71db6efaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:26.906974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ca6e73e4-bf6a-4367-958e-36e71db6efaa None None] MFA Rules not processed for user `f26e0fb38cfc4676b0f9f4bc5bea9f85`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:26.908780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ca6e73e4-bf6a-4367-958e-36e71db6efaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:26.935884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:26.947003 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a02fbe26-f993-487d-9b6c-26f3a2836558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c089fdc258454ab9d38aa40da5f727'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:26.977810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a02fbe26-f993-487d-9b6c-26f3a2836558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c089fdc258454ab9d38aa40da5f727'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:26.978591 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a02fbe26-f993-487d-9b6c-26f3a2836558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c089fdc258454ab9d38aa40da5f727'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:26.996800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a02fbe26-f993-487d-9b6c-26f3a2836558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c089fdc258454ab9d38aa40da5f727'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:27.002036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:27.016114 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a02fbe26-f993-487d-9b6c-26f3a2836558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c089fdc258454ab9d38aa40da5f727'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:27.024706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1066/2116] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:26 2022] DELETE /identity/v3/users/48c089fdc258454ab9d38aa40da5f727 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:27.029317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6fdc5-b7e6-4424-b24e-5cfbdee9ac6f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:27.029606 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6fdc5-b7e6-4424-b24e-5cfbdee9ac6f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:27.029880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6fdc5-b7e6-4424-b24e-5cfbdee9ac6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:27.047665 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1051/2117] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:27.057871 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1aa6fdc5-b7e6-4424-b24e-5cfbdee9ac6f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:27.059015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1aa6fdc5-b7e6-4424-b24e-5cfbdee9ac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:27.065460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e73e4-bf6a-4367-958e-36e71db6efaa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:27.067517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ca6e73e4-bf6a-4367-958e-36e71db6efaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:27.177890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1067/2118] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:27.193817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e73e4-bf6a-4367-958e-36e71db6efaa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:27.208877 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6fdc5-b7e6-4424-b24e-5cfbdee9ac6f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:27.213441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1aa6fdc5-b7e6-4424-b24e-5cfbdee9ac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:27.276777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3d08a-de47-425b-932a-f73b41bf3d9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:27.277522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3d08a-de47-425b-932a-f73b41bf3d9b service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:27.277801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3d08a-de47-425b-932a-f73b41bf3d9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:27.278074 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3d08a-de47-425b-932a-f73b41bf3d9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:27.317429 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6fdc5-b7e6-4424-b24e-5cfbdee9ac6f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:27.321429 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa8698-847d-4557-885b-d7e813f3cb08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:27.322259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa8698-847d-4557-885b-d7e813f3cb08 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:27.322642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa8698-847d-4557-885b-d7e813f3cb08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:27.322819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa8698-847d-4557-885b-d7e813f3cb08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:27.333558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa8698-847d-4557-885b-d7e813f3cb08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:27.335008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa8698-847d-4557-885b-d7e813f3cb08 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:27.346291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1068/2119] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:27.372053 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3d08a-de47-425b-932a-f73b41bf3d9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:27.373768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3d08a-de47-425b-932a-f73b41bf3d9b service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:27.399968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1052/2120] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:27.578130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa8698-847d-4557-885b-d7e813f3cb08 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:27.591954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa8698-847d-4557-885b-d7e813f3cb08 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:27.603821 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e8e1b-89d0-432e-af9c-776a6f973563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:27.604511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e8e1b-89d0-432e-af9c-776a6f973563 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:27.604794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e8e1b-89d0-432e-af9c-776a6f973563 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:27.605111 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e8e1b-89d0-432e-af9c-776a6f973563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:27.614427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5c2e8e1b-89d0-432e-af9c-776a6f973563 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:27.776774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e8e1b-89d0-432e-af9c-776a6f973563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:27.779539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e8e1b-89d0-432e-af9c-776a6f973563 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:27.793712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1069/2121] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:28.083404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3d08a-de47-425b-932a-f73b41bf3d9b service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:28.085372 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-87d3d08a-de47-425b-932a-f73b41bf3d9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:28.105093 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3d08a-de47-425b-932a-f73b41bf3d9b service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:28.115250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:28.116244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:28.118003 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:28.118351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] PATH_INFO: `/v3/projects/dcab6311df80472aa2c169f29f24fcaa` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:28.121859 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcab6311df80472aa2c169f29f24fcaa)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:28.124063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:28.172812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:28.235564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcab6311df80472aa2c169f29f24fcaa', 'request_id': 'req-53cc5409-d836-462b-b409-c99119b875eb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:28.249173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcab6311df80472aa2c169f29f24fcaa', 'request_id': 'req-53cc5409-d836-462b-b409-c99119b875eb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:28.257921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcab6311df80472aa2c169f29f24fcaa', 'request_id': 'req-53cc5409-d836-462b-b409-c99119b875eb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:28.273725 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] The token cache is being invalidate because project dcab6311df80472aa2c169f29f24fcaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:28.274552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:28.274692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53cc5409-d836-462b-b409-c99119b875eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:28.276276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1053/2122] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:28 2022] DELETE /identity/v3/projects/dcab6311df80472aa2c169f29f24fcaa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:28.280341 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e8e1b-89d0-432e-af9c-776a6f973563 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:28.294474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e8e1b-89d0-432e-af9c-776a6f973563 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:28.328850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:28.360162 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:28.361232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:28.361371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:28.361654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] PATH_INFO: `/v3/users/973522ec33114352ac9618720a151d60` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:28.363214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=973522ec33114352ac9618720a151d60)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:28.365179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:28.424680 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973522ec33114352ac9618720a151d60'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:28.452080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973522ec33114352ac9618720a151d60'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:28.453906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973522ec33114352ac9618720a151d60'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:28.463535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973522ec33114352ac9618720a151d60'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:28.473673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973522ec33114352ac9618720a151d60'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:28.480718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1070/2123] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:28 2022] DELETE /identity/v3/users/973522ec33114352ac9618720a151d60 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:28.697184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9c714-8e9e-410d-8121-70fe45e7f314 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:28.697681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9c714-8e9e-410d-8121-70fe45e7f314 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:28.697845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9c714-8e9e-410d-8121-70fe45e7f314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:28.733128 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-37c9c714-8e9e-410d-8121-70fe45e7f314 None None] MFA Rules not processed for user `e23fcb16b89d4fe6a6f03466f8d0d575`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:28.734403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-37c9c714-8e9e-410d-8121-70fe45e7f314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:28.854846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1054/2124] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:28.859506 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:28.861003 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:28.956248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9c714-8e9e-410d-8121-70fe45e7f314 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:28.957876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-37c9c714-8e9e-410d-8121-70fe45e7f314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:28.972443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951213a9-e353-44c5-a090-65fac7820244 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:28.980060 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862647-04b9-40ad-91b8-ef0bea90d233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:28.980743 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862647-04b9-40ad-91b8-ef0bea90d233 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:28.981054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862647-04b9-40ad-91b8-ef0bea90d233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:28.981328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862647-04b9-40ad-91b8-ef0bea90d233 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:28.982132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c862647-04b9-40ad-91b8-ef0bea90d233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:28.985000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c862647-04b9-40ad-91b8-ef0bea90d233 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.012688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9c714-8e9e-410d-8121-70fe45e7f314 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.037175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1071/2125] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:28 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:29.038500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862647-04b9-40ad-91b8-ef0bea90d233 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:29.040271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.041378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.042303 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.042743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] PATH_INFO: `/v3/projects/299e856f6ad44beaa9a0d640c8aee3f4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.049202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=299e856f6ad44beaa9a0d640c8aee3f4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.051911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.102525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:29.138227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862647-04b9-40ad-91b8-ef0bea90d233 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.179403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299e856f6ad44beaa9a0d640c8aee3f4', 'request_id': 'req-fb7ed24f-5f72-4681-9b20-cc2623223ead'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:29.198894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299e856f6ad44beaa9a0d640c8aee3f4', 'request_id': 'req-fb7ed24f-5f72-4681-9b20-cc2623223ead'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:29.216356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299e856f6ad44beaa9a0d640c8aee3f4', 'request_id': 'req-fb7ed24f-5f72-4681-9b20-cc2623223ead'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:29.241586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] The token cache is being invalidate because project 299e856f6ad44beaa9a0d640c8aee3f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:29.242627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:29.254279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fb7ed24f-5f72-4681-9b20-cc2623223ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:29.254827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1055/2126] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:28 2022] DELETE /identity/v3/projects/299e856f6ad44beaa9a0d640c8aee3f4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:29.269407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165a1eb-6e49-4f9e-a3b6-598438aa192d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.270332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165a1eb-6e49-4f9e-a3b6-598438aa192d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.270981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165a1eb-6e49-4f9e-a3b6-598438aa192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.280787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0830188-6e8a-4155-b60a-69077db0c4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.282976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0830188-6e8a-4155-b60a-69077db0c4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.283417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0830188-6e8a-4155-b60a-69077db0c4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.285248 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0830188-6e8a-4155-b60a-69077db0c4f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.286153 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0830188-6e8a-4155-b60a-69077db0c4f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.290045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0830188-6e8a-4155-b60a-69077db0c4f3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.308933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b165a1eb-6e49-4f9e-a3b6-598438aa192d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:29.310577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b165a1eb-6e49-4f9e-a3b6-598438aa192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:29.325828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1056/2127] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:29.333761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d48455-2b1a-4689-8a3a-9ce0f1a3abd4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.334078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d48455-2b1a-4689-8a3a-9ce0f1a3abd4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.334460 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d48455-2b1a-4689-8a3a-9ce0f1a3abd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.349372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1072/2128] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:29 2022] POST /identity/v3/users => generated 296 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:29.353641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0830188-6e8a-4155-b60a-69077db0c4f3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:29.359084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d0830188-6e8a-4155-b60a-69077db0c4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:29.375666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-46d48455-2b1a-4689-8a3a-9ce0f1a3abd4 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:29.376866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0830188-6e8a-4155-b60a-69077db0c4f3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.377012 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-46d48455-2b1a-4689-8a3a-9ce0f1a3abd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:29.382949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a1ade-2ac7-4f10-b7c0-42fcb50baa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.383896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a1ade-2ac7-4f10-b7c0-42fcb50baa28 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.384344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a1ade-2ac7-4f10-b7c0-42fcb50baa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.384726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a1ade-2ac7-4f10-b7c0-42fcb50baa28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.386050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a1ade-2ac7-4f10-b7c0-42fcb50baa28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.388696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a1ade-2ac7-4f10-b7c0-42fcb50baa28 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.402346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1057/2129] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:29.408581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1073/2130] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:29.409407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d48455-2b1a-4689-8a3a-9ce0f1a3abd4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:29.409761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a1ade-2ac7-4f10-b7c0-42fcb50baa28 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:29.430610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:29.430913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a1ade-2ac7-4f10-b7c0-42fcb50baa28 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.431008 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d48455-2b1a-4689-8a3a-9ce0f1a3abd4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.439769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab58ef-a007-4a48-8249-5b47c9d3aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.440762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab58ef-a007-4a48-8249-5b47c9d3aa5a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.441259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab58ef-a007-4a48-8249-5b47c9d3aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.442000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab58ef-a007-4a48-8249-5b47c9d3aa5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.443796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab58ef-a007-4a48-8249-5b47c9d3aa5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:29.444459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab58ef-a007-4a48-8249-5b47c9d3aa5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.445886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c2f7b-4ec1-498c-a038-11a83e71a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.446870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c2f7b-4ec1-498c-a038-11a83e71a874 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.447201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c2f7b-4ec1-498c-a038-11a83e71a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.447690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c2f7b-4ec1-498c-a038-11a83e71a874 admin admin] PATH_INFO: `/v3/projects/a71a1d7f6ddf4fabb0ec2e6957eee937/users/f487619bbb57419a8de600b156c0fb7a/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.448429 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab58ef-a007-4a48-8249-5b47c9d3aa5a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.471255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1074/2131] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:29.472153 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab58ef-a007-4a48-8249-5b47c9d3aa5a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:29.480791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c2f7b-4ec1-498c-a038-11a83e71a874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71a1d7f6ddf4fabb0ec2e6957eee937, user_id=f487619bbb57419a8de600b156c0fb7a, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.484100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c2f7b-4ec1-498c-a038-11a83e71a874 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.491412 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab58ef-a007-4a48-8249-5b47c9d3aa5a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.501764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5755b-3fe5-4011-9073-56651f18ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.504442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5755b-3fe5-4011-9073-56651f18ef5b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.507895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1058/2132] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:29 2022] PUT /identity/v3/projects/a71a1d7f6ddf4fabb0ec2e6957eee937/users/f487619bbb57419a8de600b156c0fb7a/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:29.508147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5755b-3fe5-4011-9073-56651f18ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.508147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5755b-3fe5-4011-9073-56651f18ef5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.508147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5755b-3fe5-4011-9073-56651f18ef5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.508533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5755b-3fe5-4011-9073-56651f18ef5b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.509493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c2f7b-4ec1-498c-a038-11a83e71a874 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:29.554876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1075/2133] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:29 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:29.559656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5755b-3fe5-4011-9073-56651f18ef5b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:29.606123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c2f7b-4ec1-498c-a038-11a83e71a874 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.648827 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5755b-3fe5-4011-9073-56651f18ef5b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.654486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a604-8487-4de5-9e59-ebf1c2fce9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.655159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a604-8487-4de5-9e59-ebf1c2fce9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.655438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a604-8487-4de5-9e59-ebf1c2fce9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.655714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a604-8487-4de5-9e59-ebf1c2fce9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.656407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424a604-8487-4de5-9e59-ebf1c2fce9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.658380 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424a604-8487-4de5-9e59-ebf1c2fce9f1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.685020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1076/2134] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:29 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:29.688942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a604-8487-4de5-9e59-ebf1c2fce9f1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:29.700984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f35f7e-fd6d-40f2-a963-7666c20cf832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.701786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f35f7e-fd6d-40f2-a963-7666c20cf832 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.702133 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f35f7e-fd6d-40f2-a963-7666c20cf832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.702416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f35f7e-fd6d-40f2-a963-7666c20cf832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.703216 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f35f7e-fd6d-40f2-a963-7666c20cf832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.704315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a604-8487-4de5-9e59-ebf1c2fce9f1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.704899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f35f7e-fd6d-40f2-a963-7666c20cf832 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.709464 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75544d33-2d7b-4fb3-bf6a-75d4ebaf74a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.710339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75544d33-2d7b-4fb3-bf6a-75d4ebaf74a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.710918 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75544d33-2d7b-4fb3-bf6a-75d4ebaf74a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.711351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75544d33-2d7b-4fb3-bf6a-75d4ebaf74a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.712251 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75544d33-2d7b-4fb3-bf6a-75d4ebaf74a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.714160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75544d33-2d7b-4fb3-bf6a-75d4ebaf74a8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.716003 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1059/2135] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:29.719942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f35f7e-fd6d-40f2-a963-7666c20cf832 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:29.729302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1077/2136] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:29.730571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f35f7e-fd6d-40f2-a963-7666c20cf832 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.733013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75544d33-2d7b-4fb3-bf6a-75d4ebaf74a8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:29.737784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b140cf-f931-4644-b378-79b731b8f497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.738698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b140cf-f931-4644-b378-79b731b8f497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.738981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b140cf-f931-4644-b378-79b731b8f497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.739255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b140cf-f931-4644-b378-79b731b8f497 admin admin] PATH_INFO: `/v3/projects/a71a1d7f6ddf4fabb0ec2e6957eee937/users/f487619bbb57419a8de600b156c0fb7a/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.742096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b140cf-f931-4644-b378-79b731b8f497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71a1d7f6ddf4fabb0ec2e6957eee937, user_id=f487619bbb57419a8de600b156c0fb7a, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.744817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b140cf-f931-4644-b378-79b731b8f497 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.747317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75544d33-2d7b-4fb3-bf6a-75d4ebaf74a8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.752522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aa873-59d5-4688-a559-9c8600b69ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.753238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aa873-59d5-4688-a559-9c8600b69ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.753522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aa873-59d5-4688-a559-9c8600b69ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.753846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aa873-59d5-4688-a559-9c8600b69ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.754631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aa873-59d5-4688-a559-9c8600b69ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.758469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1060/2137] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:29 2022] PUT /identity/v3/projects/a71a1d7f6ddf4fabb0ec2e6957eee937/users/f487619bbb57419a8de600b156c0fb7a/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:29.761064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aa873-59d5-4688-a559-9c8600b69ad4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.768565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:29.779180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1078/2138] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:32:29.780834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b140cf-f931-4644-b378-79b731b8f497 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:29.878798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b140cf-f931-4644-b378-79b731b8f497 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:29.886863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0f178-73cf-4d99-9c78-083e02d557f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:29.888084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0f178-73cf-4d99-9c78-083e02d557f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.888541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0f178-73cf-4d99-9c78-083e02d557f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.889105 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0f178-73cf-4d99-9c78-083e02d557f6 admin admin] PATH_INFO: `/v3/projects/90360d7acf9b4e7382b4121fe9e6fbaf/users/e580cfd02f524680a52879b449a45088/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.908466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0f178-73cf-4d99-9c78-083e02d557f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90360d7acf9b4e7382b4121fe9e6fbaf, user_id=e580cfd02f524680a52879b449a45088, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:29.911526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0f178-73cf-4d99-9c78-083e02d557f6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:29.914173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:29.941608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1061/2139] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:29 2022] PUT /identity/v3/projects/90360d7acf9b4e7382b4121fe9e6fbaf/users/e580cfd02f524680a52879b449a45088/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:29.943379 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b90c-26e4-48c9-9ea5-6eeef51a4ad4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:29.943974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b90c-26e4-48c9-9ea5-6eeef51a4ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:29.943974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b90c-26e4-48c9-9ea5-6eeef51a4ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:29.976277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e229b90c-26e4-48c9-9ea5-6eeef51a4ad4 None None] MFA Rules not processed for user `e580cfd02f524680a52879b449a45088`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:29.977590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e229b90c-26e4-48c9-9ea5-6eeef51a4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:30.057736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1079/2140] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:30.069949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0f178-73cf-4d99-9c78-083e02d557f6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:30.072174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9bc0f178-73cf-4d99-9c78-083e02d557f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:30.154348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0f178-73cf-4d99-9c78-083e02d557f6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:30.163472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1eb65-5eef-48fc-af8e-f51da8c4d7dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:30.164453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1eb65-5eef-48fc-af8e-f51da8c4d7dd service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:30.164628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1eb65-5eef-48fc-af8e-f51da8c4d7dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:30.164983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1eb65-5eef-48fc-af8e-f51da8c4d7dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:30.180951 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1eb65-5eef-48fc-af8e-f51da8c4d7dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:30.183338 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1eb65-5eef-48fc-af8e-f51da8c4d7dd service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:30.201077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1062/2141] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:30.342374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229b90c-26e4-48c9-9ea5-6eeef51a4ad4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:30.344449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e229b90c-26e4-48c9-9ea5-6eeef51a4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:30.446455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229b90c-26e4-48c9-9ea5-6eeef51a4ad4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:30.452400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:30.453386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:30.453670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:30.454095 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] PATH_INFO: `/v3/users/d882951da637449ba71593f10c53be7b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:30.455371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d882951da637449ba71593f10c53be7b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:30.457571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:30.580678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd882951da637449ba71593f10c53be7b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:30.603715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd882951da637449ba71593f10c53be7b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:30.604662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd882951da637449ba71593f10c53be7b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:30.617288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd882951da637449ba71593f10c53be7b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:30.636005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd882951da637449ba71593f10c53be7b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:30.676576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1080/2142] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:30 2022] DELETE /identity/v3/users/d882951da637449ba71593f10c53be7b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:30.681447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1877d1f-8376-476d-80d9-99d087915a5f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:30.681737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1877d1f-8376-476d-80d9-99d087915a5f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:30.682016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1877d1f-8376-476d-80d9-99d087915a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:30.698759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:30.701458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:30.709942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:30.738262 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d1877d1f-8376-476d-80d9-99d087915a5f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:30.744815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d1877d1f-8376-476d-80d9-99d087915a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:30.943403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a1714-d8bb-4380-a9b0-b738edc16f6f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:30.949751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b21d1d-f3fc-45c8-887e-e121eeb3ad55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:30.950753 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b21d1d-f3fc-45c8-887e-e121eeb3ad55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:30.951037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b21d1d-f3fc-45c8-887e-e121eeb3ad55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:30.951585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b21d1d-f3fc-45c8-887e-e121eeb3ad55 admin admin] PATH_INFO: `/v3/users/dff0d09de95f4d568cb1033213036d5a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:30.955313 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b21d1d-f3fc-45c8-887e-e121eeb3ad55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff0d09de95f4d568cb1033213036d5a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:30.958967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b21d1d-f3fc-45c8-887e-e121eeb3ad55 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:30.967415 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1063/2143] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:30.985680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1877d1f-8376-476d-80d9-99d087915a5f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:30.987314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d1877d1f-8376-476d-80d9-99d087915a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:31.062049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d0b21d1d-f3fc-45c8-887e-e121eeb3ad55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff0d09de95f4d568cb1033213036d5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:31.092830 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d0b21d1d-f3fc-45c8-887e-e121eeb3ad55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff0d09de95f4d568cb1033213036d5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:31.093853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d0b21d1d-f3fc-45c8-887e-e121eeb3ad55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff0d09de95f4d568cb1033213036d5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:31.111349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d0b21d1d-f3fc-45c8-887e-e121eeb3ad55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff0d09de95f4d568cb1033213036d5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:31.127100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d0b21d1d-f3fc-45c8-887e-e121eeb3ad55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff0d09de95f4d568cb1033213036d5a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:31.137064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1877d1f-8376-476d-80d9-99d087915a5f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:31.145729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1081/2144] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:30 2022] DELETE /identity/v3/users/dff0d09de95f4d568cb1033213036d5a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:31.149830 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227390f-b32f-4b76-8098-215fea256fce None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:31.150258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227390f-b32f-4b76-8098-215fea256fce None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:31.150871 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f600c-f3df-405f-ae0a-740894085674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:31.151060 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227390f-b32f-4b76-8098-215fea256fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:31.151848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f600c-f3df-405f-ae0a-740894085674 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:31.152299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f600c-f3df-405f-ae0a-740894085674 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:31.152709 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f600c-f3df-405f-ae0a-740894085674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:31.156236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4e6f600c-f3df-405f-ae0a-740894085674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:31.175696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e227390f-b32f-4b76-8098-215fea256fce None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:31.177760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e227390f-b32f-4b76-8098-215fea256fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:31.188948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f600c-f3df-405f-ae0a-740894085674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:31.190988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f600c-f3df-405f-ae0a-740894085674 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:31.204050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1064/2145] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:32:31.273262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1082/2146] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:31.314313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f600c-f3df-405f-ae0a-740894085674 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:31.317608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4e6f600c-f3df-405f-ae0a-740894085674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:31.339467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f600c-f3df-405f-ae0a-740894085674 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:31.414146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:31.443906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f29034-ef61-487b-a318-f860176da039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:31.446805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f29034-ef61-487b-a318-f860176da039 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:31.447350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f29034-ef61-487b-a318-f860176da039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:31.448107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f29034-ef61-487b-a318-f860176da039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:31.460836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f29034-ef61-487b-a318-f860176da039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:31.463276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f29034-ef61-487b-a318-f860176da039 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:31.481341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1065/2147] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:32.279512 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227390f-b32f-4b76-8098-215fea256fce None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:32.281129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e227390f-b32f-4b76-8098-215fea256fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:32.313500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227390f-b32f-4b76-8098-215fea256fce None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:32.325934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:32.326960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:32.327368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:32.327735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] PATH_INFO: `/v3/projects/b708e888274c466f817c8765650943a1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:32.331505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b708e888274c466f817c8765650943a1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:32.333536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:32.412048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:32.514414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b708e888274c466f817c8765650943a1', 'request_id': 'req-45a2f713-f2fd-423e-a753-03fb9240419f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:32.547671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b708e888274c466f817c8765650943a1', 'request_id': 'req-45a2f713-f2fd-423e-a753-03fb9240419f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:32.564370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b708e888274c466f817c8765650943a1', 'request_id': 'req-45a2f713-f2fd-423e-a753-03fb9240419f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:32.599522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] The token cache is being invalidate because project b708e888274c466f817c8765650943a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:32.599820 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:32.607653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:32.615089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1083/2148] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:32 2022] DELETE /identity/v3/projects/b708e888274c466f817c8765650943a1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:32.621034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaba9c-9fd2-4b60-ac5c-8a40cdc29de4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:32.621693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaba9c-9fd2-4b60-ac5c-8a40cdc29de4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:32.621877 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaba9c-9fd2-4b60-ac5c-8a40cdc29de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:32.645622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-28eaba9c-9fd2-4b60-ac5c-8a40cdc29de4 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:32.647015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-28eaba9c-9fd2-4b60-ac5c-8a40cdc29de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:32.820211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1066/2149] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:32.826727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:32.828634 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259c528-a860-40c0-ba2f-42b4c5ddf077 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:32.829123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:32.829337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259c528-a860-40c0-ba2f-42b4c5ddf077 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:32.829816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259c528-a860-40c0-ba2f-42b4c5ddf077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:32.852829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2f713-f2fd-423e-a753-03fb9240419f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:32.863311 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:32.864991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:32.865376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:32.865791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] PATH_INFO: `/v3/projects/96dc90a038ea4243a7ec7f6b6c2c7360` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:32.867192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=96dc90a038ea4243a7ec7f6b6c2c7360)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:32.873011 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:32.874418 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7259c528-a860-40c0-ba2f-42b4c5ddf077 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:32.875809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7259c528-a860-40c0-ba2f-42b4c5ddf077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:32.903027 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1067/2150] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:32.906934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259c528-a860-40c0-ba2f-42b4c5ddf077 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:32.925681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259c528-a860-40c0-ba2f-42b4c5ddf077 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:32.948131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70df5f-e493-49b1-89da-b61a3dba2886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:32.948131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70df5f-e493-49b1-89da-b61a3dba2886 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:32.949379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70df5f-e493-49b1-89da-b61a3dba2886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:32.949379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70df5f-e493-49b1-89da-b61a3dba2886 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:32.952913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70df5f-e493-49b1-89da-b61a3dba2886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:32.953303 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70df5f-e493-49b1-89da-b61a3dba2886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:32.954973 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70df5f-e493-49b1-89da-b61a3dba2886 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:32.968903 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96dc90a038ea4243a7ec7f6b6c2c7360', 'request_id': 'req-33315726-6d88-4b45-b4ca-4201140261fe'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:32.988353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96dc90a038ea4243a7ec7f6b6c2c7360', 'request_id': 'req-33315726-6d88-4b45-b4ca-4201140261fe'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:33.000676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1068/2151] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:33.001227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70df5f-e493-49b1-89da-b61a3dba2886 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:33.005611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96dc90a038ea4243a7ec7f6b6c2c7360', 'request_id': 'req-33315726-6d88-4b45-b4ca-4201140261fe'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:33.021680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70df5f-e493-49b1-89da-b61a3dba2886 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:33.032703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] The token cache is being invalidate because project 96dc90a038ea4243a7ec7f6b6c2c7360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:33.032994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:33.034871 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:33.043483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1084/2152] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:32 2022] DELETE /identity/v3/projects/96dc90a038ea4243a7ec7f6b6c2c7360 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:33.044491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:33.051634 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:33.216678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c93d97-9e22-4a6f-b552-575e7edb995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:33.217595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c93d97-9e22-4a6f-b552-575e7edb995e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:33.217884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c93d97-9e22-4a6f-b552-575e7edb995e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:33.218162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c93d97-9e22-4a6f-b552-575e7edb995e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:33.218882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c93d97-9e22-4a6f-b552-575e7edb995e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:33.223192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c93d97-9e22-4a6f-b552-575e7edb995e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:33.235306 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33315726-6d88-4b45-b4ca-4201140261fe admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:33.260617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:33.261781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:33.261925 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:33.262088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] PATH_INFO: `/v3/users/f26e0fb38cfc4676b0f9f4bc5bea9f85` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:33.265969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26e0fb38cfc4676b0f9f4bc5bea9f85)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:33.271220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:33.301560 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1069/2153] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:33 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:33.307000 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c93d97-9e22-4a6f-b552-575e7edb995e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:33.308823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-90c93d97-9e22-4a6f-b552-575e7edb995e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:33.355848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:33.387064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26e0fb38cfc4676b0f9f4bc5bea9f85'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:33.415396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26e0fb38cfc4676b0f9f4bc5bea9f85'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:33.418441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26e0fb38cfc4676b0f9f4bc5bea9f85'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:33.447617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26e0fb38cfc4676b0f9f4bc5bea9f85'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:33.455051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:33.474795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26e0fb38cfc4676b0f9f4bc5bea9f85'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:33.488042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1085/2154] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:33 2022] DELETE /identity/v3/users/f26e0fb38cfc4676b0f9f4bc5bea9f85 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:33.511431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c93d97-9e22-4a6f-b552-575e7edb995e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:33.689978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de5782-91e0-4902-92df-b5b820998378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:33.690864 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de5782-91e0-4902-92df-b5b820998378 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:33.690992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de5782-91e0-4902-92df-b5b820998378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:33.691227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de5782-91e0-4902-92df-b5b820998378 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:33.691936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de5782-91e0-4902-92df-b5b820998378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:33.693946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de5782-91e0-4902-92df-b5b820998378 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:33.728693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:33.730475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1070/2155] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:33 2022] POST /identity/v3/users => generated 293 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:33.733433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:33.767039 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63635e-fe02-4a9d-88d8-c9a7d290c379 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:33.772731 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40d639-e5c1-4019-93ea-09745e77e501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:33.773831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40d639-e5c1-4019-93ea-09745e77e501 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:33.774263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40d639-e5c1-4019-93ea-09745e77e501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:33.775425 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40d639-e5c1-4019-93ea-09745e77e501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:33.776444 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40d639-e5c1-4019-93ea-09745e77e501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:33.778225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40d639-e5c1-4019-93ea-09745e77e501 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:33.791712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1086/2156] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:33.795907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de5782-91e0-4902-92df-b5b820998378 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:33.817401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de5782-91e0-4902-92df-b5b820998378 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:33.822334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb11dcd-e078-412e-80b1-94db495f9240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:33.823028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb11dcd-e078-412e-80b1-94db495f9240 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:33.823305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb11dcd-e078-412e-80b1-94db495f9240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:33.823577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb11dcd-e078-412e-80b1-94db495f9240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:33.824315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb11dcd-e078-412e-80b1-94db495f9240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:33.826090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb11dcd-e078-412e-80b1-94db495f9240 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:33.842144 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40d639-e5c1-4019-93ea-09745e77e501 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:33.853832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1071/2157] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:33.854668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40d639-e5c1-4019-93ea-09745e77e501 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:33.861494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9740a-2251-47d1-8ea2-2c7a0386d95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:33.862798 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9740a-2251-47d1-8ea2-2c7a0386d95f admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:33.863082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9740a-2251-47d1-8ea2-2c7a0386d95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:33.863353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9740a-2251-47d1-8ea2-2c7a0386d95f admin admin] PATH_INFO: `/v3/projects/019d7b6cb8b74a80b675ccf6ec2f3acd/users/58434b0ebada488b9570c46f99935713/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:33.888335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9740a-2251-47d1-8ea2-2c7a0386d95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=019d7b6cb8b74a80b675ccf6ec2f3acd, user_id=58434b0ebada488b9570c46f99935713, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:33.891204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9740a-2251-47d1-8ea2-2c7a0386d95f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:33.912444 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1087/2158] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:33 2022] PUT /identity/v3/projects/019d7b6cb8b74a80b675ccf6ec2f3acd/users/58434b0ebada488b9570c46f99935713/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:33.924245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8d35f-2231-47b3-9355-4a413c87fcec None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:33.924929 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8d35f-2231-47b3-9355-4a413c87fcec None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:33.925313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8d35f-2231-47b3-9355-4a413c87fcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:33.956944 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6bd8d35f-2231-47b3-9355-4a413c87fcec None None] MFA Rules not processed for user `58434b0ebada488b9570c46f99935713`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:33.958195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6bd8d35f-2231-47b3-9355-4a413c87fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:34.066229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9740a-2251-47d1-8ea2-2c7a0386d95f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:34.068430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1072/2159] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:34.156297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9740a-2251-47d1-8ea2-2c7a0386d95f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:34.164471 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5d61-7012-4ca7-8a66-5a425a2a5748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:34.165685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5d61-7012-4ca7-8a66-5a425a2a5748 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:34.165966 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5d61-7012-4ca7-8a66-5a425a2a5748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:34.166240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5d61-7012-4ca7-8a66-5a425a2a5748 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:34.167129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb5d61-7012-4ca7-8a66-5a425a2a5748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:34.169117 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb5d61-7012-4ca7-8a66-5a425a2a5748 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:34.207847 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1088/2160] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:34 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:34.212530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8d35f-2231-47b3-9355-4a413c87fcec None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:34.225764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8d35f-2231-47b3-9355-4a413c87fcec None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:34.318791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509e7e7-5b68-47fc-8f4f-6b57685c8c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:34.319736 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509e7e7-5b68-47fc-8f4f-6b57685c8c03 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:34.320085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509e7e7-5b68-47fc-8f4f-6b57685c8c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:34.320414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509e7e7-5b68-47fc-8f4f-6b57685c8c03 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:34.321598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509e7e7-5b68-47fc-8f4f-6b57685c8c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:34.323930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509e7e7-5b68-47fc-8f4f-6b57685c8c03 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:34.336429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:34.360895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5d61-7012-4ca7-8a66-5a425a2a5748 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:34.361833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1073/2161] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:34 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:34.380050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5d61-7012-4ca7-8a66-5a425a2a5748 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:34.417353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae38bd-3b6b-464c-a9cb-61aa283e0be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:34.418401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae38bd-3b6b-464c-a9cb-61aa283e0be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:34.419424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae38bd-3b6b-464c-a9cb-61aa283e0be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:34.419711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae38bd-3b6b-464c-a9cb-61aa283e0be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:34.420467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae38bd-3b6b-464c-a9cb-61aa283e0be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:34.427135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae38bd-3b6b-464c-a9cb-61aa283e0be0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:34.458954 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509e7e7-5b68-47fc-8f4f-6b57685c8c03 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:34.464491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1089/2162] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:32:34.471880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509e7e7-5b68-47fc-8f4f-6b57685c8c03 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:34.499059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03aa22-4175-406e-b1b1-7571c1ed4a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:34.499288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03aa22-4175-406e-b1b1-7571c1ed4a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:34.499524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03aa22-4175-406e-b1b1-7571c1ed4a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:34.499722 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03aa22-4175-406e-b1b1-7571c1ed4a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:34.500500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03aa22-4175-406e-b1b1-7571c1ed4a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:34.505380 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03aa22-4175-406e-b1b1-7571c1ed4a99 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:34.537394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae38bd-3b6b-464c-a9cb-61aa283e0be0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:34.548342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1074/2163] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:34.550617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae38bd-3b6b-464c-a9cb-61aa283e0be0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:34.572476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03aa22-4175-406e-b1b1-7571c1ed4a99 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:34.577505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ef03aa22-4175-406e-b1b1-7571c1ed4a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:34.582905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa14787-f8c9-45fc-8a57-24df8d69849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:34.584679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa14787-f8c9-45fc-8a57-24df8d69849a admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:34.586947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa14787-f8c9-45fc-8a57-24df8d69849a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:34.589188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa14787-f8c9-45fc-8a57-24df8d69849a admin admin] PATH_INFO: `/v3/projects/da104a9610434a52b8cac9f48bf35937/users/775930813fa044aba22cc3ab6eb6285f/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:34.619373 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03aa22-4175-406e-b1b1-7571c1ed4a99 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:34.638337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5019c6e-de54-4cb5-a3d7-9a528307962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:34.639237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019c6e-de54-4cb5-a3d7-9a528307962a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:34.639515 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019c6e-de54-4cb5-a3d7-9a528307962a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:34.639824 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019c6e-de54-4cb5-a3d7-9a528307962a admin admin] PATH_INFO: `/v3/users/e580cfd02f524680a52879b449a45088` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:34.642506 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa14787-f8c9-45fc-8a57-24df8d69849a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da104a9610434a52b8cac9f48bf35937, user_id=775930813fa044aba22cc3ab6eb6285f, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:34.645243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa14787-f8c9-45fc-8a57-24df8d69849a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:34.646161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5019c6e-de54-4cb5-a3d7-9a528307962a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e580cfd02f524680a52879b449a45088)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:34.648081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5019c6e-de54-4cb5-a3d7-9a528307962a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:34.679818 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1090/2164] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:34 2022] PUT /identity/v3/projects/da104a9610434a52b8cac9f48bf35937/users/775930813fa044aba22cc3ab6eb6285f/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:34.690344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd6f47-cfc9-442e-b4be-b1450b862ccb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:34.690972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd6f47-cfc9-442e-b4be-b1450b862ccb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:34.691497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd6f47-cfc9-442e-b4be-b1450b862ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:34.753869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-01dd6f47-cfc9-442e-b4be-b1450b862ccb None None] MFA Rules not processed for user `775930813fa044aba22cc3ab6eb6285f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:34.757698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-01dd6f47-cfc9-442e-b4be-b1450b862ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:34.811010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f5019c6e-de54-4cb5-a3d7-9a528307962a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e580cfd02f524680a52879b449a45088'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:34.815452 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:34.879537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f5019c6e-de54-4cb5-a3d7-9a528307962a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e580cfd02f524680a52879b449a45088'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:34.882599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f5019c6e-de54-4cb5-a3d7-9a528307962a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e580cfd02f524680a52879b449a45088'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:34.886774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f5019c6e-de54-4cb5-a3d7-9a528307962a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e580cfd02f524680a52879b449a45088'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:34.904346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1091/2165] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:34.909190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd6f47-cfc9-442e-b4be-b1450b862ccb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:34.909423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f5019c6e-de54-4cb5-a3d7-9a528307962a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e580cfd02f524680a52879b449a45088'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:34.955849 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1075/2166] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:34 2022] DELETE /identity/v3/users/e580cfd02f524680a52879b449a45088 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:34.961340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c220ce4-04f3-409b-a6c2-bad6fff275ef None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:34.961633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c220ce4-04f3-409b-a6c2-bad6fff275ef None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:34.961919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c220ce4-04f3-409b-a6c2-bad6fff275ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:34.998135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd6f47-cfc9-442e-b4be-b1450b862ccb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:35.019654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7c220ce4-04f3-409b-a6c2-bad6fff275ef None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:35.021270 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7c220ce4-04f3-409b-a6c2-bad6fff275ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:35.101308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1076/2167] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:35.116078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c220ce4-04f3-409b-a6c2-bad6fff275ef None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:35.117911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7c220ce4-04f3-409b-a6c2-bad6fff275ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:35.134048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b79f1c-9c7e-48f7-967e-7c1778c44d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:35.135209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b79f1c-9c7e-48f7-967e-7c1778c44d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.135769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b79f1c-9c7e-48f7-967e-7c1778c44d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.136424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b79f1c-9c7e-48f7-967e-7c1778c44d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.140330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b79f1c-9c7e-48f7-967e-7c1778c44d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:35.146231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b79f1c-9c7e-48f7-967e-7c1778c44d3f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:35.200990 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1092/2168] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:34 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:35.206782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b79f1c-9c7e-48f7-967e-7c1778c44d3f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:35.209962 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-51b79f1c-9c7e-48f7-967e-7c1778c44d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:35.231891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c220ce4-04f3-409b-a6c2-bad6fff275ef None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:35.242915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:35.289849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:35.313215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b79f1c-9c7e-48f7-967e-7c1778c44d3f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:35.313943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efb40a-c7e9-41f4-97e3-865ee541765f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:35.315429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb40a-c7e9-41f4-97e3-865ee541765f service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.315726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb40a-c7e9-41f4-97e3-865ee541765f service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.316170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb40a-c7e9-41f4-97e3-865ee541765f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.318525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b0a3d-e13d-4c67-94ce-f260842d9f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:35.319345 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b0a3d-e13d-4c67-94ce-f260842d9f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.319773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b0a3d-e13d-4c67-94ce-f260842d9f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.320064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b0a3d-e13d-4c67-94ce-f260842d9f69 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.320772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b0a3d-e13d-4c67-94ce-f260842d9f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:35.322833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b0a3d-e13d-4c67-94ce-f260842d9f69 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:35.329426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efb40a-c7e9-41f4-97e3-865ee541765f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:35.330389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efb40a-c7e9-41f4-97e3-865ee541765f service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:35.344260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1077/2169] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:35.345263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efb40a-c7e9-41f4-97e3-865ee541765f service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:35.346654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-18efb40a-c7e9-41f4-97e3-865ee541765f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:35.361662 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efb40a-c7e9-41f4-97e3-865ee541765f service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:35.369240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:35.370614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.370799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.371044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] PATH_INFO: `/v3/projects/01eb56a277cf4014ad7f76687707388b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.372485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01eb56a277cf4014ad7f76687707388b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:35.375139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:35.375270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1093/2170] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:35 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:35.379527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b0a3d-e13d-4c67-94ce-f260842d9f69 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:35.403552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b0a3d-e13d-4c67-94ce-f260842d9f69 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:35.418262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1097858-2686-4d95-bb77-11310437563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:35.421013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1097858-2686-4d95-bb77-11310437563b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.421316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1097858-2686-4d95-bb77-11310437563b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.421592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1097858-2686-4d95-bb77-11310437563b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.422358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1097858-2686-4d95-bb77-11310437563b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:35.427944 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1097858-2686-4d95-bb77-11310437563b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:35.452783 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01eb56a277cf4014ad7f76687707388b', 'request_id': 'req-22a08163-1aa1-44e7-a051-e63d281acad5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:35.471573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01eb56a277cf4014ad7f76687707388b', 'request_id': 'req-22a08163-1aa1-44e7-a051-e63d281acad5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:35.472819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1094/2171] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:35.473909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1097858-2686-4d95-bb77-11310437563b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:35.486637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01eb56a277cf4014ad7f76687707388b', 'request_id': 'req-22a08163-1aa1-44e7-a051-e63d281acad5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:35.487797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1097858-2686-4d95-bb77-11310437563b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:35.512641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] The token cache is being invalidate because project 01eb56a277cf4014ad7f76687707388b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:35.513352 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:35.518595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22a08163-1aa1-44e7-a051-e63d281acad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:35.519712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1078/2172] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:35 2022] DELETE /identity/v3/projects/01eb56a277cf4014ad7f76687707388b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:35.525144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afce26f-2484-4c22-8a8f-f54c187dc92b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.525452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afce26f-2484-4c22-8a8f-f54c187dc92b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.525693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afce26f-2484-4c22-8a8f-f54c187dc92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.568081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2afce26f-2484-4c22-8a8f-f54c187dc92b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:35.569269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2afce26f-2484-4c22-8a8f-f54c187dc92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:35.593900 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd95e1f-23d1-4446-82a3-d258e4427a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:35.595007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd95e1f-23d1-4446-82a3-d258e4427a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.595334 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd95e1f-23d1-4446-82a3-d258e4427a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.595667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd95e1f-23d1-4446-82a3-d258e4427a58 admin admin] PATH_INFO: `/v3/projects/77bf917369c94665b038825cdd7855a7/users/ec6d56c3217444f691624fcc3c384c23/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.617898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd95e1f-23d1-4446-82a3-d258e4427a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bf917369c94665b038825cdd7855a7, user_id=ec6d56c3217444f691624fcc3c384c23, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:35.622339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd95e1f-23d1-4446-82a3-d258e4427a58 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:35.667770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1095/2173] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:35 2022] PUT /identity/v3/projects/77bf917369c94665b038825cdd7855a7/users/ec6d56c3217444f691624fcc3c384c23/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:35.673656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd95e1f-23d1-4446-82a3-d258e4427a58 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:35.682073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ddd95e1f-23d1-4446-82a3-d258e4427a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:35.751650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1079/2174] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:35.759274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50cd96-a6db-498f-b5d6-5028dfa181e7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.759685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50cd96-a6db-498f-b5d6-5028dfa181e7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.760060 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50cd96-a6db-498f-b5d6-5028dfa181e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.798688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6c50cd96-a6db-498f-b5d6-5028dfa181e7 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:35.802236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6c50cd96-a6db-498f-b5d6-5028dfa181e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:35.821406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd95e1f-23d1-4446-82a3-d258e4427a58 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:35.822203 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1080/2175] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:35.826608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50cd96-a6db-498f-b5d6-5028dfa181e7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:35.838503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbbced-854a-44c1-a681-99152c82f871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:35.839029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbbced-854a-44c1-a681-99152c82f871 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.839287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50cd96-a6db-498f-b5d6-5028dfa181e7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:35.839402 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbbced-854a-44c1-a681-99152c82f871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.839575 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbbced-854a-44c1-a681-99152c82f871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.840336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbbced-854a-44c1-a681-99152c82f871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:35.844067 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbbced-854a-44c1-a681-99152c82f871 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:35.844390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eeffc-3eea-46e1-a370-4b67d10c3ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:35.845532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eeffc-3eea-46e1-a370-4b67d10c3ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.845973 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eeffc-3eea-46e1-a370-4b67d10c3ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.846500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eeffc-3eea-46e1-a370-4b67d10c3ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.847420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eeffc-3eea-46e1-a370-4b67d10c3ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:35.847908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eeffc-3eea-46e1-a370-4b67d10c3ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:35.850365 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eeffc-3eea-46e1-a370-4b67d10c3ffc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:35.870400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1096/2176] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:35.871617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbbced-854a-44c1-a681-99152c82f871 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:35.884697 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1081/2177] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:35.885979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eeffc-3eea-46e1-a370-4b67d10c3ffc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:35.898778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbbced-854a-44c1-a681-99152c82f871 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:35.905639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eeffc-3eea-46e1-a370-4b67d10c3ffc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:35.909855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc346ab-1ff0-4544-a7f7-b9b58a8f2322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:35.910885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc346ab-1ff0-4544-a7f7-b9b58a8f2322 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.911261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc346ab-1ff0-4544-a7f7-b9b58a8f2322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.911633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc346ab-1ff0-4544-a7f7-b9b58a8f2322 admin admin] PATH_INFO: `/v3/projects/77bf917369c94665b038825cdd7855a7/users/ec6d56c3217444f691624fcc3c384c23/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.915724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc346ab-1ff0-4544-a7f7-b9b58a8f2322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bf917369c94665b038825cdd7855a7, user_id=ec6d56c3217444f691624fcc3c384c23, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:35.918624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc346ab-1ff0-4544-a7f7-b9b58a8f2322 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:35.922499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f4e1-ea3a-4b82-9352-b4729a6f68fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:35.923307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f4e1-ea3a-4b82-9352-b4729a6f68fc admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.923682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f4e1-ea3a-4b82-9352-b4729a6f68fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.924050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f4e1-ea3a-4b82-9352-b4729a6f68fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.924891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f4e1-ea3a-4b82-9352-b4729a6f68fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:35.927100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f4e1-ea3a-4b82-9352-b4729a6f68fc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:35.947394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1097/2178] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:35 2022] PUT /identity/v3/projects/77bf917369c94665b038825cdd7855a7/users/ec6d56c3217444f691624fcc3c384c23/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:35.959068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961dd7-d67d-4bb4-becd-237ba2ba0477 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:35.959430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961dd7-d67d-4bb4-becd-237ba2ba0477 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:35.959777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961dd7-d67d-4bb4-becd-237ba2ba0477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:35.969301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:35.991702 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1082/2179] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:35 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:35.995392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f4e1-ea3a-4b82-9352-b4729a6f68fc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:36.005973 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3e961dd7-d67d-4bb4-becd-237ba2ba0477 None None] MFA Rules not processed for user `ec6d56c3217444f691624fcc3c384c23`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:36.007219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3e961dd7-d67d-4bb4-becd-237ba2ba0477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:36.058552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:36.140217 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f4e1-ea3a-4b82-9352-b4729a6f68fc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:36.151433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84294d17-c282-4851-b9bb-83a030bc64aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:36.152122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294d17-c282-4851-b9bb-83a030bc64aa admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:36.152523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294d17-c282-4851-b9bb-83a030bc64aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:36.152778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294d17-c282-4851-b9bb-83a030bc64aa admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:36.153597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84294d17-c282-4851-b9bb-83a030bc64aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:36.156215 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84294d17-c282-4851-b9bb-83a030bc64aa admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:36.182668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1098/2180] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:36.183644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e961dd7-d67d-4bb4-becd-237ba2ba0477 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:36.200921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3e961dd7-d67d-4bb4-becd-237ba2ba0477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:36.204767 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1083/2181] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:35 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:36.208373 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84294d17-c282-4851-b9bb-83a030bc64aa admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:36.234198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84294d17-c282-4851-b9bb-83a030bc64aa admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:36.246281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923eebd9-8c80-456b-b7a5-d3cf56e4d3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:36.247082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923eebd9-8c80-456b-b7a5-d3cf56e4d3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:36.247361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923eebd9-8c80-456b-b7a5-d3cf56e4d3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:36.248007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923eebd9-8c80-456b-b7a5-d3cf56e4d3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:36.248386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923eebd9-8c80-456b-b7a5-d3cf56e4d3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:36.251135 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923eebd9-8c80-456b-b7a5-d3cf56e4d3b2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:36.271614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e961dd7-d67d-4bb4-becd-237ba2ba0477 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:36.277509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:36.278783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:36.279494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:36.279945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] PATH_INFO: `/v3/projects/90360d7acf9b4e7382b4121fe9e6fbaf` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:36.285245 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90360d7acf9b4e7382b4121fe9e6fbaf)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:36.285955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1084/2182] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:36.286728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923eebd9-8c80-456b-b7a5-d3cf56e4d3b2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:36.288252 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:36.289712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-923eebd9-8c80-456b-b7a5-d3cf56e4d3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:36.384001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90360d7acf9b4e7382b4121fe9e6fbaf', 'request_id': 'req-63b64193-3b9c-46ab-83ee-1e31fe432354'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:36.398261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923eebd9-8c80-456b-b7a5-d3cf56e4d3b2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:36.402162 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90360d7acf9b4e7382b4121fe9e6fbaf', 'request_id': 'req-63b64193-3b9c-46ab-83ee-1e31fe432354'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:36.410607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90360d7acf9b4e7382b4121fe9e6fbaf', 'request_id': 'req-63b64193-3b9c-46ab-83ee-1e31fe432354'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:36.434490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] The token cache is being invalidate because project 90360d7acf9b4e7382b4121fe9e6fbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:36.434971 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:36.435945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:36.437944 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1099/2183] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:36 2022] DELETE /identity/v3/projects/90360d7acf9b4e7382b4121fe9e6fbaf => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:36.439015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:36.441779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:36.489218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad919327-86cf-4f00-acf5-a6d41599bec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:36.489974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919327-86cf-4f00-acf5-a6d41599bec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:36.490256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919327-86cf-4f00-acf5-a6d41599bec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:36.491774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919327-86cf-4f00-acf5-a6d41599bec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:36.493938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ad919327-86cf-4f00-acf5-a6d41599bec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:36.540145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b64193-3b9c-46ab-83ee-1e31fe432354 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:36.547531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4274d0-02c8-45b1-89d4-901d1d996d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:36.549984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4274d0-02c8-45b1-89d4-901d1d996d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:36.550450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4274d0-02c8-45b1-89d4-901d1d996d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:36.550890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4274d0-02c8-45b1-89d4-901d1d996d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:36.551943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4274d0-02c8-45b1-89d4-901d1d996d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:36.554291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4274d0-02c8-45b1-89d4-901d1d996d3f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:36.566893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1100/2184] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:36.568629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33563c0f-27ae-4337-9f65-c117a886db04 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:36.569144 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33563c0f-27ae-4337-9f65-c117a886db04 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:36.569578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33563c0f-27ae-4337-9f65-c117a886db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:36.590954 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:36.616854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-33563c0f-27ae-4337-9f65-c117a886db04 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:36.620773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-33563c0f-27ae-4337-9f65-c117a886db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:36.621108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad919327-86cf-4f00-acf5-a6d41599bec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:36.623775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad919327-86cf-4f00-acf5-a6d41599bec1 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:36.638596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1101/2185] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:36.639816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33563c0f-27ae-4337-9f65-c117a886db04 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:36.651360 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1085/2186] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:36.653574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9712a-b8c8-43dc-be1a-d0be749925aa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:36.653916 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33563c0f-27ae-4337-9f65-c117a886db04 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:36.654113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9712a-b8c8-43dc-be1a-d0be749925aa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:36.654275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9712a-b8c8-43dc-be1a-d0be749925aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:36.660255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a73a91-e9e6-4777-916a-fad1cc6d2697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:36.661299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73a91-e9e6-4777-916a-fad1cc6d2697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:36.661578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73a91-e9e6-4777-916a-fad1cc6d2697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:36.661851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73a91-e9e6-4777-916a-fad1cc6d2697 admin admin] PATH_INFO: `/v3/projects/4380a4e9c1c448609749e30b6d23ba2f/users/6510d328dcde4b9db46d16964e6cfd85/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:36.680618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8fc9712a-b8c8-43dc-be1a-d0be749925aa None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:36.680906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a73a91-e9e6-4777-916a-fad1cc6d2697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4380a4e9c1c448609749e30b6d23ba2f, user_id=6510d328dcde4b9db46d16964e6cfd85, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:36.682124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8fc9712a-b8c8-43dc-be1a-d0be749925aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:36.684094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a73a91-e9e6-4777-916a-fad1cc6d2697 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:36.700532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1086/2187] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:36.705145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1102/2188] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:36 2022] PUT /identity/v3/projects/4380a4e9c1c448609749e30b6d23ba2f/users/6510d328dcde4b9db46d16964e6cfd85/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:36.709974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9712a-b8c8-43dc-be1a-d0be749925aa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:36.715171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc02de-95c7-436e-8037-2969ba26ecaf None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:36.715597 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc02de-95c7-436e-8037-2969ba26ecaf None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:36.715963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc02de-95c7-436e-8037-2969ba26ecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:36.724390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9712a-b8c8-43dc-be1a-d0be749925aa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:36.726754 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:36.767186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bbfc02de-95c7-436e-8037-2969ba26ecaf None None] MFA Rules not processed for user `6510d328dcde4b9db46d16964e6cfd85`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:36.768575 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bbfc02de-95c7-436e-8037-2969ba26ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:36.865359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf8536-7ef2-4abf-83a3-9f84cdaa7761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:36.866572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf8536-7ef2-4abf-83a3-9f84cdaa7761 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:36.866572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf8536-7ef2-4abf-83a3-9f84cdaa7761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:36.866572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf8536-7ef2-4abf-83a3-9f84cdaa7761 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:36.868685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf8536-7ef2-4abf-83a3-9f84cdaa7761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:36.875253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf8536-7ef2-4abf-83a3-9f84cdaa7761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:36.875253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf8536-7ef2-4abf-83a3-9f84cdaa7761 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:36.931463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1087/2189] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:36.937659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf8536-7ef2-4abf-83a3-9f84cdaa7761 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:36.952677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1103/2190] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:36.957340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc02de-95c7-436e-8037-2969ba26ecaf None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:36.973866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc02de-95c7-436e-8037-2969ba26ecaf None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:36.979894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf8536-7ef2-4abf-83a3-9f84cdaa7761 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:36.983581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89c750-98f2-47e2-931c-61a0e928e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:36.984481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89c750-98f2-47e2-931c-61a0e928e3cb admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:36.984836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89c750-98f2-47e2-931c-61a0e928e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:36.985178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89c750-98f2-47e2-931c-61a0e928e3cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:36.985891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89c750-98f2-47e2-931c-61a0e928e3cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:36.989410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89c750-98f2-47e2-931c-61a0e928e3cb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:36.999775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1344e-8a3c-45bc-bac4-10d7b0a37336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:37.001905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1344e-8a3c-45bc-bac4-10d7b0a37336 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.002397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1344e-8a3c-45bc-bac4-10d7b0a37336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.003167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1344e-8a3c-45bc-bac4-10d7b0a37336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.004095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1344e-8a3c-45bc-bac4-10d7b0a37336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:37.009355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1344e-8a3c-45bc-bac4-10d7b0a37336 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:37.029639 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1104/2191] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:36 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:37.031598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89c750-98f2-47e2-931c-61a0e928e3cb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:37.087953 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1088/2192] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:36 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:37.089369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1344e-8a3c-45bc-bac4-10d7b0a37336 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:37.136351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89c750-98f2-47e2-931c-61a0e928e3cb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:37.193353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1344e-8a3c-45bc-bac4-10d7b0a37336 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:37.212945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52518b8-c222-4bbc-bfad-da4c9c30c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:37.213955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52518b8-c222-4bbc-bfad-da4c9c30c479 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.214248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52518b8-c222-4bbc-bfad-da4c9c30c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.214524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52518b8-c222-4bbc-bfad-da4c9c30c479 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.215921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52518b8-c222-4bbc-bfad-da4c9c30c479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:37.218171 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52518b8-c222-4bbc-bfad-da4c9c30c479 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:37.252884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6111-d13c-4481-ac4e-f626a4169048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:37.253950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6111-d13c-4481-ac4e-f626a4169048 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.254318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6111-d13c-4481-ac4e-f626a4169048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.254704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6111-d13c-4481-ac4e-f626a4169048 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.255597 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb6111-d13c-4481-ac4e-f626a4169048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:37.257797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb6111-d13c-4481-ac4e-f626a4169048 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:37.258562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1089/2193] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:37 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:37.259658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52518b8-c222-4bbc-bfad-da4c9c30c479 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:37.271573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52518b8-c222-4bbc-bfad-da4c9c30c479 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:37.278863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dc810-17cd-49a0-8024-580a2ecd68cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:37.279609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dc810-17cd-49a0-8024-580a2ecd68cd admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.279887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dc810-17cd-49a0-8024-580a2ecd68cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.280254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dc810-17cd-49a0-8024-580a2ecd68cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.281034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dc810-17cd-49a0-8024-580a2ecd68cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:37.285220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dc810-17cd-49a0-8024-580a2ecd68cd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:37.314851 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1090/2194] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:37.316546 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dc810-17cd-49a0-8024-580a2ecd68cd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:37.328711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1105/2195] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:37 2022] POST /identity/v3/users => generated 298 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:37.332690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6111-d13c-4481-ac4e-f626a4169048 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:37.335220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dc810-17cd-49a0-8024-580a2ecd68cd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:37.356987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2addb-d678-4083-9259-b68c15eab00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:37.356987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2addb-d678-4083-9259-b68c15eab00e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.356987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2addb-d678-4083-9259-b68c15eab00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.356987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2addb-d678-4083-9259-b68c15eab00e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.357338 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2addb-d678-4083-9259-b68c15eab00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:37.357338 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2addb-d678-4083-9259-b68c15eab00e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:37.357694 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6111-d13c-4481-ac4e-f626a4169048 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:37.366581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939d34-a6fc-48ba-b8f8-8fcbb61530f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:37.367545 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939d34-a6fc-48ba-b8f8-8fcbb61530f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.368349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939d34-a6fc-48ba-b8f8-8fcbb61530f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.368780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939d34-a6fc-48ba-b8f8-8fcbb61530f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.369593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1091/2196] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:37.370574 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90939d34-a6fc-48ba-b8f8-8fcbb61530f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:37.372920 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90939d34-a6fc-48ba-b8f8-8fcbb61530f4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:37.373083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2addb-d678-4083-9259-b68c15eab00e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:37.378814 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:37.411354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2addb-d678-4083-9259-b68c15eab00e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:37.411890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1106/2197] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:37.415795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939d34-a6fc-48ba-b8f8-8fcbb61530f4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:37.437705 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db690ee-dbcc-4a09-9b7e-11e63ad6941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:37.438807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db690ee-dbcc-4a09-9b7e-11e63ad6941e admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.438931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db690ee-dbcc-4a09-9b7e-11e63ad6941e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.439144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db690ee-dbcc-4a09-9b7e-11e63ad6941e admin admin] PATH_INFO: `/v3/projects/0eb9b809ea014f6aa73d8daa9c4e1e6d/users/379b9d83fdc741ba92fa198a3bc5f108/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.442041 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939d34-a6fc-48ba-b8f8-8fcbb61530f4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:37.454009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4e5ff-b1fa-4f33-8e67-8111e9464f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:37.455962 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4e5ff-b1fa-4f33-8e67-8111e9464f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.459567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4e5ff-b1fa-4f33-8e67-8111e9464f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.460281 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4e5ff-b1fa-4f33-8e67-8111e9464f1c admin admin] PATH_INFO: `/v3/projects/c7b0b97f43f74198904195719a26e21a/users/4bce5a22999641bc86177d0a300034bd/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.496518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4e5ff-b1fa-4f33-8e67-8111e9464f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b0b97f43f74198904195719a26e21a, user_id=4bce5a22999641bc86177d0a300034bd, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:37.506580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db690ee-dbcc-4a09-9b7e-11e63ad6941e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb9b809ea014f6aa73d8daa9c4e1e6d, user_id=379b9d83fdc741ba92fa198a3bc5f108, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:37.512107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db690ee-dbcc-4a09-9b7e-11e63ad6941e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:37.512288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4e5ff-b1fa-4f33-8e67-8111e9464f1c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:37.522986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:37.548684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1107/2198] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:37 2022] PUT /identity/v3/projects/c7b0b97f43f74198904195719a26e21a/users/4bce5a22999641bc86177d0a300034bd/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:37.550269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4e5ff-b1fa-4f33-8e67-8111e9464f1c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:37.550556 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1092/2199] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:37 2022] PUT /identity/v3/projects/0eb9b809ea014f6aa73d8daa9c4e1e6d/users/379b9d83fdc741ba92fa198a3bc5f108/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:37.554750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fdebb-a31a-40fb-9c13-d9b28d879896 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.555041 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fdebb-a31a-40fb-9c13-d9b28d879896 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.555335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fdebb-a31a-40fb-9c13-d9b28d879896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.593386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4f1fdebb-a31a-40fb-9c13-d9b28d879896 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:37.596494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4f1fdebb-a31a-40fb-9c13-d9b28d879896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:37.686469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4e5ff-b1fa-4f33-8e67-8111e9464f1c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:37.696366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87ee86-b926-41ae-beca-c3c7398c2c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:37.696366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87ee86-b926-41ae-beca-c3c7398c2c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.696366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87ee86-b926-41ae-beca-c3c7398c2c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.697082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1093/2200] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:37.705092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87ee86-b926-41ae-beca-c3c7398c2c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.706774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87ee86-b926-41ae-beca-c3c7398c2c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:37.715930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fdebb-a31a-40fb-9c13-d9b28d879896 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:37.717306 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87ee86-b926-41ae-beca-c3c7398c2c81 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:37.718336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4f1fdebb-a31a-40fb-9c13-d9b28d879896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:37.748706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1108/2201] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:37.752883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87ee86-b926-41ae-beca-c3c7398c2c81 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:37.771696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87ee86-b926-41ae-beca-c3c7398c2c81 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:37.783881 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a5090-dd74-46b5-be61-e7fc043d25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:37.784866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5090-dd74-46b5-be61-e7fc043d25ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.785200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5090-dd74-46b5-be61-e7fc043d25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.785478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5090-dd74-46b5-be61-e7fc043d25ff admin admin] PATH_INFO: `/v3/projects/c7b0b97f43f74198904195719a26e21a/users/4bce5a22999641bc86177d0a300034bd/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.787817 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a5090-dd74-46b5-be61-e7fc043d25ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b0b97f43f74198904195719a26e21a, user_id=4bce5a22999641bc86177d0a300034bd, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:37.790678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a5090-dd74-46b5-be61-e7fc043d25ff admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:37.815220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1109/2202] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:37 2022] PUT /identity/v3/projects/c7b0b97f43f74198904195719a26e21a/users/4bce5a22999641bc86177d0a300034bd/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:37.829453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea67172-88b1-47b8-9c56-3f96bbbd3ca5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.829749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea67172-88b1-47b8-9c56-3f96bbbd3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.830807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea67172-88b1-47b8-9c56-3f96bbbd3ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:37.879260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fdebb-a31a-40fb-9c13-d9b28d879896 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:37.887642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-eea67172-88b1-47b8-9c56-3f96bbbd3ca5 None None] MFA Rules not processed for user `4bce5a22999641bc86177d0a300034bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:37.888889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eea67172-88b1-47b8-9c56-3f96bbbd3ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:37.996272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83491f11-0641-4076-844c-0350be8f64ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:37.997145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83491f11-0641-4076-844c-0350be8f64ca service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:37.997496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83491f11-0641-4076-844c-0350be8f64ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:37.997836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83491f11-0641-4076-844c-0350be8f64ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:38.072576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1110/2203] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:38.081016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea67172-88b1-47b8-9c56-3f96bbbd3ca5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:38.082134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eea67172-88b1-47b8-9c56-3f96bbbd3ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:38.155816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83491f11-0641-4076-844c-0350be8f64ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:38.157347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83491f11-0641-4076-844c-0350be8f64ca service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:38.174147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:38.183545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1094/2204] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:38.185341 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:38.209167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea67172-88b1-47b8-9c56-3f96bbbd3ca5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:38.214883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285bffe-f248-4cf6-b6d8-d182eefb73a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:38.216950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285bffe-f248-4cf6-b6d8-d182eefb73a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:38.217286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285bffe-f248-4cf6-b6d8-d182eefb73a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:38.217566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285bffe-f248-4cf6-b6d8-d182eefb73a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:38.230816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285bffe-f248-4cf6-b6d8-d182eefb73a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:38.236740 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285bffe-f248-4cf6-b6d8-d182eefb73a5 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:38.262401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1111/2205] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:32:38.378243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22bc07-6dde-4ee7-8681-e0d2d219f576 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:38.379067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22bc07-6dde-4ee7-8681-e0d2d219f576 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:38.379343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22bc07-6dde-4ee7-8681-e0d2d219f576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:38.397013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285bffe-f248-4cf6-b6d8-d182eefb73a5 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:38.399826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b285bffe-f248-4cf6-b6d8-d182eefb73a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:38.421931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285bffe-f248-4cf6-b6d8-d182eefb73a5 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:38.439101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2954f-00be-4204-a4b8-a49d312b8e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:38.439101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2954f-00be-4204-a4b8-a49d312b8e23 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:38.439101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2954f-00be-4204-a4b8-a49d312b8e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:38.439101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2954f-00be-4204-a4b8-a49d312b8e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:38.453059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fd22bc07-6dde-4ee7-8681-e0d2d219f576 None None] MFA Rules not processed for user `f487619bbb57419a8de600b156c0fb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:38.457994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fd22bc07-6dde-4ee7-8681-e0d2d219f576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:38.560426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1095/2206] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:38.564683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2954f-00be-4204-a4b8-a49d312b8e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:38.566904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2954f-00be-4204-a4b8-a49d312b8e23 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:38.567834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22bc07-6dde-4ee7-8681-e0d2d219f576 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:38.569908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fd22bc07-6dde-4ee7-8681-e0d2d219f576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:38.592238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1112/2207] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:38.697657 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2954f-00be-4204-a4b8-a49d312b8e23 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:38.700989 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22bc07-6dde-4ee7-8681-e0d2d219f576 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:38.708093 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c77d8f-47b5-44c3-9ae6-8ee4e3a84e2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:38.709973 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2954f-00be-4204-a4b8-a49d312b8e23 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:38.713141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c77d8f-47b5-44c3-9ae6-8ee4e3a84e2d service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:38.713936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c77d8f-47b5-44c3-9ae6-8ee4e3a84e2d service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:38.714317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c77d8f-47b5-44c3-9ae6-8ee4e3a84e2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:38.717093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1df7c-172d-4cb9-b9d3-f018cf0d93f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:38.717764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1df7c-172d-4cb9-b9d3-f018cf0d93f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:38.718095 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1df7c-172d-4cb9-b9d3-f018cf0d93f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:38.718375 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1df7c-172d-4cb9-b9d3-f018cf0d93f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:38.719393 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c8c77d8f-47b5-44c3-9ae6-8ee4e3a84e2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:38.720654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a4a1df7c-172d-4cb9-b9d3-f018cf0d93f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:38.873336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c77d8f-47b5-44c3-9ae6-8ee4e3a84e2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:38.877850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c77d8f-47b5-44c3-9ae6-8ee4e3a84e2d service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:38.910549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1df7c-172d-4cb9-b9d3-f018cf0d93f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:38.912555 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1df7c-172d-4cb9-b9d3-f018cf0d93f7 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:38.931763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1113/2208] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:38.954126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1096/2209] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:32:39.089216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccec5a-c9db-473f-9c49-c7e05101c2e8 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:39.089598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccec5a-c9db-473f-9c49-c7e05101c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:39.090084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccec5a-c9db-473f-9c49-c7e05101c2e8 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:39.091883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1114/2210] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:32:39.167136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadff19-dff1-4479-80f7-7e4c4ed8cb4a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:39.167517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadff19-dff1-4479-80f7-7e4c4ed8cb4a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:39.167797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadff19-dff1-4479-80f7-7e4c4ed8cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:39.212780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cdadff19-dff1-4479-80f7-7e4c4ed8cb4a None None] MFA Rules not processed for user `e0df36a267464042908bbd8eebc7c40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:39.215171 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cdadff19-dff1-4479-80f7-7e4c4ed8cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:39.224038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccec5a-c9db-473f-9c49-c7e05101c2e8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:39.251685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccec5a-c9db-473f-9c49-c7e05101c2e8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:39.261774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:39.263379 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:39.263661 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:39.263935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] PATH_INFO: `/v3/users/6510d328dcde4b9db46d16964e6cfd85` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:39.270599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6510d328dcde4b9db46d16964e6cfd85)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:39.272723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:39.274739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:39.397299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6510d328dcde4b9db46d16964e6cfd85'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:39.403668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1097/2211] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:32:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:39.404791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadff19-dff1-4479-80f7-7e4c4ed8cb4a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:39.410816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cdadff19-dff1-4479-80f7-7e4c4ed8cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:39.428156 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6510d328dcde4b9db46d16964e6cfd85'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:39.429061 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6510d328dcde4b9db46d16964e6cfd85'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:39.442898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6510d328dcde4b9db46d16964e6cfd85'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:39.453087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:39.454987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadff19-dff1-4479-80f7-7e4c4ed8cb4a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:39.460550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6510d328dcde4b9db46d16964e6cfd85'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:39.465588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707494-aafe-46e1-b00e-bef0f126b89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:39.467659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707494-aafe-46e1-b00e-bef0f126b89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:39.467954 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707494-aafe-46e1-b00e-bef0f126b89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:39.468238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707494-aafe-46e1-b00e-bef0f126b89d admin admin] PATH_INFO: `/v3/users/54246fdf77f9409daa0d3ba70a30e8ca` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:39.473576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3707494-aafe-46e1-b00e-bef0f126b89d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54246fdf77f9409daa0d3ba70a30e8ca)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:39.474689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1115/2212] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:39 2022] DELETE /identity/v3/users/6510d328dcde4b9db46d16964e6cfd85 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:39.478612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:39.479653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3707494-aafe-46e1-b00e-bef0f126b89d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:39.480850 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:39.596170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b3707494-aafe-46e1-b00e-bef0f126b89d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54246fdf77f9409daa0d3ba70a30e8ca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:39.630994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b3707494-aafe-46e1-b00e-bef0f126b89d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54246fdf77f9409daa0d3ba70a30e8ca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:39.631997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b3707494-aafe-46e1-b00e-bef0f126b89d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54246fdf77f9409daa0d3ba70a30e8ca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:39.633504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b3707494-aafe-46e1-b00e-bef0f126b89d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54246fdf77f9409daa0d3ba70a30e8ca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:39.669759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b3707494-aafe-46e1-b00e-bef0f126b89d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54246fdf77f9409daa0d3ba70a30e8ca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:39.718202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1098/2213] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:39 2022] DELETE /identity/v3/users/54246fdf77f9409daa0d3ba70a30e8ca => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:39.721186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1513c-4193-4dc4-85fe-89c600301968 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:39.721737 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1513c-4193-4dc4-85fe-89c600301968 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:39.722091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1513c-4193-4dc4-85fe-89c600301968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:39.733056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e67ea-590c-4046-bd6d-549aa49933f8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:39.750281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-61e1513c-4193-4dc4-85fe-89c600301968 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:39.751876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-61e1513c-4193-4dc4-85fe-89c600301968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:39.848806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1099/2214] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:39.888139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1513c-4193-4dc4-85fe-89c600301968 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:39.889988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-61e1513c-4193-4dc4-85fe-89c600301968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:39.894674 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb92cd-d0b6-4c06-9160-fa5bbbf0919a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df36a267464042908bbd8eebc7c40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:39.895763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb92cd-d0b6-4c06-9160-fa5bbbf0919a service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:39.896286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb92cd-d0b6-4c06-9160-fa5bbbf0919a service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:39.896870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb92cd-d0b6-4c06-9160-fa5bbbf0919a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:39.901700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6ebb92cd-d0b6-4c06-9160-fa5bbbf0919a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:39.924425 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb92cd-d0b6-4c06-9160-fa5bbbf0919a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:39.926635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb92cd-d0b6-4c06-9160-fa5bbbf0919a service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:39.949437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1116/2215] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:39.977215 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:40.045295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1513c-4193-4dc4-85fe-89c600301968 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:40.053739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18094d-386a-4f2c-bb26-f4262b074bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:40.054837 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18094d-386a-4f2c-bb26-f4262b074bad service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:40.055266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18094d-386a-4f2c-bb26-f4262b074bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:40.055731 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18094d-386a-4f2c-bb26-f4262b074bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:40.076966 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18094d-386a-4f2c-bb26-f4262b074bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:40.078642 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18094d-386a-4f2c-bb26-f4262b074bad service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:40.096780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb92cd-d0b6-4c06-9160-fa5bbbf0919a service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:40.098977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6ebb92cd-d0b6-4c06-9160-fa5bbbf0919a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:40.112793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1100/2216] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:32:40.210430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb92cd-d0b6-4c06-9160-fa5bbbf0919a service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:40.217879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751872-bb6d-40a7-9fc6-d7fbcb697ae0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:40.218598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751872-bb6d-40a7-9fc6-d7fbcb697ae0 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:40.218989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751872-bb6d-40a7-9fc6-d7fbcb697ae0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:40.219270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751872-bb6d-40a7-9fc6-d7fbcb697ae0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:40.221723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8d751872-bb6d-40a7-9fc6-d7fbcb697ae0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:40.281023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:40.313504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d751872-bb6d-40a7-9fc6-d7fbcb697ae0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:40.315260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d751872-bb6d-40a7-9fc6-d7fbcb697ae0 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:40.327742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1117/2217] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:32:40.412214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18094d-386a-4f2c-bb26-f4262b074bad service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:40.413756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1b18094d-386a-4f2c-bb26-f4262b074bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:40.435401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18094d-386a-4f2c-bb26-f4262b074bad service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:40.462370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:40.463619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:40.464981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:40.466364 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] PATH_INFO: `/v3/projects/d24ad9d569c7405dadf53c160977b0eb` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:40.470295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24ad9d569c7405dadf53c160977b0eb)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:40.482238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:40.587493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24ad9d569c7405dadf53c160977b0eb', 'request_id': 'req-57f95992-9ad8-499f-8909-2bf0549c2736'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:40.603982 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24ad9d569c7405dadf53c160977b0eb', 'request_id': 'req-57f95992-9ad8-499f-8909-2bf0549c2736'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:40.615415 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24ad9d569c7405dadf53c160977b0eb', 'request_id': 'req-57f95992-9ad8-499f-8909-2bf0549c2736'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:40.675931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751872-bb6d-40a7-9fc6-d7fbcb697ae0 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:40.678267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8d751872-bb6d-40a7-9fc6-d7fbcb697ae0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:40.680815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] The token cache is being invalidate because project d24ad9d569c7405dadf53c160977b0eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:40.683140 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:40.685656 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-57f95992-9ad8-499f-8909-2bf0549c2736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:40.694876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1101/2218] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:40 2022] DELETE /identity/v3/projects/d24ad9d569c7405dadf53c160977b0eb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:40.701270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751872-bb6d-40a7-9fc6-d7fbcb697ae0 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:40.702647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c56f-29d2-4d04-9639-0caa264cd4b1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:40.704090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c56f-29d2-4d04-9639-0caa264cd4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:40.704577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c56f-29d2-4d04-9639-0caa264cd4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:40.733328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7576c56f-29d2-4d04-9639-0caa264cd4b1 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:40.735527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7576c56f-29d2-4d04-9639-0caa264cd4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:40.822584 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:40.823586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:40.823989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:40.824357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] PATH_INFO: `/v3/projects/4380a4e9c1c448609749e30b6d23ba2f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:40.826254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4380a4e9c1c448609749e30b6d23ba2f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:40.833423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:40.882627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1102/2219] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:40.885713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5f0d-7884-41c9-ba83-d183cd7e72f9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:40.885991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5f0d-7884-41c9-ba83-d183cd7e72f9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:40.886264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5f0d-7884-41c9-ba83-d183cd7e72f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:40.940627 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-16ac5f0d-7884-41c9-ba83-d183cd7e72f9 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:40.941902 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-16ac5f0d-7884-41c9-ba83-d183cd7e72f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:40.953659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4380a4e9c1c448609749e30b6d23ba2f', 'request_id': 'req-96e71973-4ab2-4d15-895c-22e64ec025e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:40.963583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4380a4e9c1c448609749e30b6d23ba2f', 'request_id': 'req-96e71973-4ab2-4d15-895c-22e64ec025e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:40.979551 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4380a4e9c1c448609749e30b6d23ba2f', 'request_id': 'req-96e71973-4ab2-4d15-895c-22e64ec025e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:41.001977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] The token cache is being invalidate because project 4380a4e9c1c448609749e30b6d23ba2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:41.002364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:41.003583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:41.010490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1118/2220] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:40 2022] DELETE /identity/v3/projects/4380a4e9c1c448609749e30b6d23ba2f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:41.010490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:41.012709 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:41.058585 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:41.080734 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1103/2221] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:41.085943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac5f0d-7884-41c9-ba83-d183cd7e72f9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:41.098882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac5f0d-7884-41c9-ba83-d183cd7e72f9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:41.105581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e67b30-b116-4fa0-94c6-802acba9ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:41.106695 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e67b30-b116-4fa0-94c6-802acba9ecaa admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:41.107731 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e67b30-b116-4fa0-94c6-802acba9ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:41.108180 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e67b30-b116-4fa0-94c6-802acba9ecaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:41.109307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e67b30-b116-4fa0-94c6-802acba9ecaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:41.109950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e67b30-b116-4fa0-94c6-802acba9ecaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:41.113576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e67b30-b116-4fa0-94c6-802acba9ecaa admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:41.127977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1104/2222] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:41.132225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e67b30-b116-4fa0-94c6-802acba9ecaa admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:41.145133 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e67b30-b116-4fa0-94c6-802acba9ecaa admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:41.153214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c9ef9-22aa-4cfb-9754-31af96ff6659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:41.154200 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9ef9-22aa-4cfb-9754-31af96ff6659 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:41.154657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9ef9-22aa-4cfb-9754-31af96ff6659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:41.156032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9ef9-22aa-4cfb-9754-31af96ff6659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:41.156151 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e71973-4ab2-4d15-895c-22e64ec025e7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:41.157525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9ef9-22aa-4cfb-9754-31af96ff6659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:41.159795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9ef9-22aa-4cfb-9754-31af96ff6659 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:41.170476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:41.171460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:41.172414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:41.172414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] PATH_INFO: `/v3/users/4bce5a22999641bc86177d0a300034bd` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:41.173620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bce5a22999641bc86177d0a300034bd)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:41.175556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:41.202313 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:41.231882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1105/2223] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:41 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:41.235266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c9ef9-22aa-4cfb-9754-31af96ff6659 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:41.310984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bce5a22999641bc86177d0a300034bd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:41.336633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bce5a22999641bc86177d0a300034bd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:41.338052 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bce5a22999641bc86177d0a300034bd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:41.342611 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c9ef9-22aa-4cfb-9754-31af96ff6659 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:41.350578 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99692af-bae2-4b7e-8f07-c33f55f638fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:41.350901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bce5a22999641bc86177d0a300034bd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:41.351569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99692af-bae2-4b7e-8f07-c33f55f638fd admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:41.351917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99692af-bae2-4b7e-8f07-c33f55f638fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:41.352988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99692af-bae2-4b7e-8f07-c33f55f638fd admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:41.354125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99692af-bae2-4b7e-8f07-c33f55f638fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:41.357197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99692af-bae2-4b7e-8f07-c33f55f638fd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:41.363261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bce5a22999641bc86177d0a300034bd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:41.371554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1119/2224] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:41 2022] DELETE /identity/v3/users/4bce5a22999641bc86177d0a300034bd => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:41.399374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1106/2225] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:41 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:41.400672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:41.402467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:41.502150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f007e-d104-47b7-8d8a-411797397696 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:41.509487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a599815-c9d6-4649-92b9-56dde742fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:41.514261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a599815-c9d6-4649-92b9-56dde742fa96 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:41.514700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a599815-c9d6-4649-92b9-56dde742fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:41.515078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a599815-c9d6-4649-92b9-56dde742fa96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:41.517873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a599815-c9d6-4649-92b9-56dde742fa96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:41.517873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a599815-c9d6-4649-92b9-56dde742fa96 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:41.555856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99692af-bae2-4b7e-8f07-c33f55f638fd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:41.564426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1120/2226] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:32:41.573873 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99692af-bae2-4b7e-8f07-c33f55f638fd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:41.592668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0485894-94b8-4842-aebb-af6e24bb74f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:41.593936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0485894-94b8-4842-aebb-af6e24bb74f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:41.594343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0485894-94b8-4842-aebb-af6e24bb74f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:41.594716 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0485894-94b8-4842-aebb-af6e24bb74f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:41.597130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0485894-94b8-4842-aebb-af6e24bb74f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:41.598888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0485894-94b8-4842-aebb-af6e24bb74f5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:41.625532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1107/2227] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:41.629835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a599815-c9d6-4649-92b9-56dde742fa96 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:41.645697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a599815-c9d6-4649-92b9-56dde742fa96 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:41.657971 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d503ea-ee47-42a2-a548-364067fb68f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:41.659505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d503ea-ee47-42a2-a548-364067fb68f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:41.659887 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d503ea-ee47-42a2-a548-364067fb68f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:41.660287 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d503ea-ee47-42a2-a548-364067fb68f7 admin admin] PATH_INFO: `/v3/projects/df05070f4ae741e4b6aca85bd7122096/users/1be5b81ab404479bb03c91675a0d9eae/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:41.710684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d503ea-ee47-42a2-a548-364067fb68f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df05070f4ae741e4b6aca85bd7122096, user_id=1be5b81ab404479bb03c91675a0d9eae, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:41.716888 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d503ea-ee47-42a2-a548-364067fb68f7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:41.745144 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1121/2228] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:41 2022] PUT /identity/v3/projects/df05070f4ae741e4b6aca85bd7122096/users/1be5b81ab404479bb03c91675a0d9eae/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:41.757800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dacd2-772e-4475-b550-bb244fc46626 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:41.758191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dacd2-772e-4475-b550-bb244fc46626 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:41.758541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dacd2-772e-4475-b550-bb244fc46626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:41.849728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-654dacd2-772e-4475-b550-bb244fc46626 None None] MFA Rules not processed for user `1be5b81ab404479bb03c91675a0d9eae`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:41.851944 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d503ea-ee47-42a2-a548-364067fb68f7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:41.853839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-654dacd2-772e-4475-b550-bb244fc46626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:41.858285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c6d503ea-ee47-42a2-a548-364067fb68f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:42.018013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1108/2229] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:42.026570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dacd2-772e-4475-b550-bb244fc46626 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:42.028381 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-654dacd2-772e-4475-b550-bb244fc46626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:42.055768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:42.066194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d503ea-ee47-42a2-a548-364067fb68f7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:42.084819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:42.085893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:42.086236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:42.086516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] PATH_INFO: `/v3/projects/c7b0b97f43f74198904195719a26e21a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:42.095919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b0b97f43f74198904195719a26e21a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:42.098047 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:42.102981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:42.195910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dacd2-772e-4475-b550-bb244fc46626 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:42.203859 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348b2fb-1e09-45f8-9501-445a113dc84c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:42.204658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348b2fb-1e09-45f8-9501-445a113dc84c service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:42.205107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348b2fb-1e09-45f8-9501-445a113dc84c service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:42.205504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348b2fb-1e09-45f8-9501-445a113dc84c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:42.216694 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348b2fb-1e09-45f8-9501-445a113dc84c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:42.219028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348b2fb-1e09-45f8-9501-445a113dc84c service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:42.242884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1109/2230] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:42.295493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b0b97f43f74198904195719a26e21a', 'request_id': 'req-be05b777-244a-44b5-8e87-ecd5a30c3485'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:42.323298 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b0b97f43f74198904195719a26e21a', 'request_id': 'req-be05b777-244a-44b5-8e87-ecd5a30c3485'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:42.342606 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b0b97f43f74198904195719a26e21a', 'request_id': 'req-be05b777-244a-44b5-8e87-ecd5a30c3485'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:42.374157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] The token cache is being invalidate because project c7b0b97f43f74198904195719a26e21a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:42.374558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:42.377333 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-be05b777-244a-44b5-8e87-ecd5a30c3485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:42.379542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1122/2231] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:41 2022] DELETE /identity/v3/projects/c7b0b97f43f74198904195719a26e21a => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:42.384560 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5a3d7-71f5-489f-8e73-4d9ad56e805a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:42.384991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5a3d7-71f5-489f-8e73-4d9ad56e805a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:42.385389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5a3d7-71f5-489f-8e73-4d9ad56e805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:42.419383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2df5a3d7-71f5-489f-8e73-4d9ad56e805a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:42.420939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2df5a3d7-71f5-489f-8e73-4d9ad56e805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:42.621100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1110/2232] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:42.630917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c1e1-72b9-4672-bb9b-cadc8ae509a7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:42.631187 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c1e1-72b9-4672-bb9b-cadc8ae509a7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:42.631664 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c1e1-72b9-4672-bb9b-cadc8ae509a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:42.692336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5a3d7-71f5-489f-8e73-4d9ad56e805a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:42.694067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2df5a3d7-71f5-489f-8e73-4d9ad56e805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:42.713512 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0983c1e1-72b9-4672-bb9b-cadc8ae509a7 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:42.716184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0983c1e1-72b9-4672-bb9b-cadc8ae509a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:42.736383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5a3d7-71f5-489f-8e73-4d9ad56e805a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:42.742586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1123/2233] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:42.746554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983c1e1-72b9-4672-bb9b-cadc8ae509a7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:42.768716 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6e92e-3cd3-46b4-9796-8c7a437c05c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:42.769275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983c1e1-72b9-4672-bb9b-cadc8ae509a7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:42.769723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e92e-3cd3-46b4-9796-8c7a437c05c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:42.770181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e92e-3cd3-46b4-9796-8c7a437c05c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:42.770608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e92e-3cd3-46b4-9796-8c7a437c05c0 admin admin] PATH_INFO: `/v3/users/1be5b81ab404479bb03c91675a0d9eae` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:42.773455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6e92e-3cd3-46b4-9796-8c7a437c05c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be5b81ab404479bb03c91675a0d9eae)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:42.780862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccb708-0134-4fd7-9a94-b807e01088c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:42.782260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccb708-0134-4fd7-9a94-b807e01088c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:42.782690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccb708-0134-4fd7-9a94-b807e01088c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:42.783474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccb708-0134-4fd7-9a94-b807e01088c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:42.784373 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccb708-0134-4fd7-9a94-b807e01088c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:42.784828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccb708-0134-4fd7-9a94-b807e01088c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:42.785062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6e92e-3cd3-46b4-9796-8c7a437c05c0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:42.787546 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccb708-0134-4fd7-9a94-b807e01088c4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:42.807848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1124/2234] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:42.815276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccb708-0134-4fd7-9a94-b807e01088c4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:42.848512 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccb708-0134-4fd7-9a94-b807e01088c4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:42.864672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8412dd-29e8-41f7-9ebb-628774f178a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:42.865495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8412dd-29e8-41f7-9ebb-628774f178a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:42.865774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8412dd-29e8-41f7-9ebb-628774f178a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:42.866575 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8412dd-29e8-41f7-9ebb-628774f178a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:42.867427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8412dd-29e8-41f7-9ebb-628774f178a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:42.870750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8412dd-29e8-41f7-9ebb-628774f178a5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:42.920637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b3f6e92e-3cd3-46b4-9796-8c7a437c05c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be5b81ab404479bb03c91675a0d9eae'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:42.962867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1125/2235] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:42 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:42.964082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8412dd-29e8-41f7-9ebb-628774f178a5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:42.973445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b3f6e92e-3cd3-46b4-9796-8c7a437c05c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be5b81ab404479bb03c91675a0d9eae'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:42.974422 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b3f6e92e-3cd3-46b4-9796-8c7a437c05c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be5b81ab404479bb03c91675a0d9eae'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:42.975975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b3f6e92e-3cd3-46b4-9796-8c7a437c05c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be5b81ab404479bb03c91675a0d9eae'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:42.997999 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b3f6e92e-3cd3-46b4-9796-8c7a437c05c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be5b81ab404479bb03c91675a0d9eae'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:43.045632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1111/2236] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:42 2022] DELETE /identity/v3/users/1be5b81ab404479bb03c91675a0d9eae => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:43.047322 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6e178-fc20-491a-9bc0-103134f05912 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:43.047609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6e178-fc20-491a-9bc0-103134f05912 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:43.048755 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6e178-fc20-491a-9bc0-103134f05912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:43.076854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8412dd-29e8-41f7-9ebb-628774f178a5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:43.078442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-dff6e178-fc20-491a-9bc0-103134f05912 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:43.080272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dff6e178-fc20-491a-9bc0-103134f05912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:43.155147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:43.187607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:43.204979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25682fc-eac1-408e-abd6-6c46eb79072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:43.206919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25682fc-eac1-408e-abd6-6c46eb79072e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:43.207802 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25682fc-eac1-408e-abd6-6c46eb79072e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:43.208214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25682fc-eac1-408e-abd6-6c46eb79072e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:43.209076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25682fc-eac1-408e-abd6-6c46eb79072e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:43.211331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25682fc-eac1-408e-abd6-6c46eb79072e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:43.250301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1126/2237] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:42 2022] POST /identity/v3/users => generated 287 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:43.254904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25682fc-eac1-408e-abd6-6c46eb79072e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:43.257886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b25682fc-eac1-408e-abd6-6c46eb79072e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:43.285630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1112/2238] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:43.293156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6e178-fc20-491a-9bc0-103134f05912 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:43.294868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dff6e178-fc20-491a-9bc0-103134f05912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:43.297648 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25682fc-eac1-408e-abd6-6c46eb79072e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:43.303497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa41b9-dc01-4270-90f6-e278b71e3759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:43.304425 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa41b9-dc01-4270-90f6-e278b71e3759 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:43.304688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa41b9-dc01-4270-90f6-e278b71e3759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:43.305019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa41b9-dc01-4270-90f6-e278b71e3759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:43.305960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa41b9-dc01-4270-90f6-e278b71e3759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:43.309402 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa41b9-dc01-4270-90f6-e278b71e3759 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:43.327724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1127/2239] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:43.329073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa41b9-dc01-4270-90f6-e278b71e3759 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:43.374951 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa41b9-dc01-4270-90f6-e278b71e3759 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:43.390351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b397d2-7ce4-4673-af30-f9210427f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:43.392977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b397d2-7ce4-4673-af30-f9210427f9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:43.393491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b397d2-7ce4-4673-af30-f9210427f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:43.394104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b397d2-7ce4-4673-af30-f9210427f9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:43.395049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b397d2-7ce4-4673-af30-f9210427f9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:43.398398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b397d2-7ce4-4673-af30-f9210427f9f2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:43.413277 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1128/2240] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:43.418271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b397d2-7ce4-4673-af30-f9210427f9f2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:43.453296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b397d2-7ce4-4673-af30-f9210427f9f2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:43.466564 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10abe-b724-4fb1-9e75-f661d9f64736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:43.467600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10abe-b724-4fb1-9e75-f661d9f64736 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:43.467982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10abe-b724-4fb1-9e75-f661d9f64736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:43.468286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10abe-b724-4fb1-9e75-f661d9f64736 admin admin] PATH_INFO: `/v3/projects/0fc3c738a6d7435dbb8eaae960bff179/users/943d6d0943814dc69a85dc004d211dfe/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:43.506925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6e178-fc20-491a-9bc0-103134f05912 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:43.515830 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e2c0-a783-49ea-8eb2-9e884508aa0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:43.516516 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e2c0-a783-49ea-8eb2-9e884508aa0d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:43.516852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e2c0-a783-49ea-8eb2-9e884508aa0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:43.517238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e2c0-a783-49ea-8eb2-9e884508aa0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:43.532597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76e2c0-a783-49ea-8eb2-9e884508aa0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:43.534465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76e2c0-a783-49ea-8eb2-9e884508aa0d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:43.564608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1113/2241] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:32:43.566417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c10abe-b724-4fb1-9e75-f661d9f64736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc3c738a6d7435dbb8eaae960bff179, user_id=943d6d0943814dc69a85dc004d211dfe, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:43.569148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c10abe-b724-4fb1-9e75-f661d9f64736 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:43.623783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1129/2242] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:43 2022] PUT /identity/v3/projects/0fc3c738a6d7435dbb8eaae960bff179/users/943d6d0943814dc69a85dc004d211dfe/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:43.634218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7aeee-e189-4afe-bd8a-06f8987ee3e9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:43.634582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7aeee-e189-4afe-bd8a-06f8987ee3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:43.634932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7aeee-e189-4afe-bd8a-06f8987ee3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:43.707836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-96a7aeee-e189-4afe-bd8a-06f8987ee3e9 None None] MFA Rules not processed for user `943d6d0943814dc69a85dc004d211dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:43.713800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-96a7aeee-e189-4afe-bd8a-06f8987ee3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:43.827998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1114/2243] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:43.847698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10abe-b724-4fb1-9e75-f661d9f64736 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:43.849858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-69c10abe-b724-4fb1-9e75-f661d9f64736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:43.947766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10abe-b724-4fb1-9e75-f661d9f64736 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:43.952209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad5051-6e85-4fe1-8e59-b0aabd26f6d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:43.953218 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad5051-6e85-4fe1-8e59-b0aabd26f6d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:43.953820 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad5051-6e85-4fe1-8e59-b0aabd26f6d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:43.954256 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad5051-6e85-4fe1-8e59-b0aabd26f6d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:43.970237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad5051-6e85-4fe1-8e59-b0aabd26f6d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:43.972404 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad5051-6e85-4fe1-8e59-b0aabd26f6d9 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:43.998812 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1130/2244] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:44.012886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7aeee-e189-4afe-bd8a-06f8987ee3e9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:44.188768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7aeee-e189-4afe-bd8a-06f8987ee3e9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:44.197076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:44.199147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:44.202021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:44.202337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] PATH_INFO: `/v3/users/943d6d0943814dc69a85dc004d211dfe` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:44.205425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=943d6d0943814dc69a85dc004d211dfe)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:44.209918 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:44.215555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:44.332337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943d6d0943814dc69a85dc004d211dfe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:44.377241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943d6d0943814dc69a85dc004d211dfe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:44.384099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943d6d0943814dc69a85dc004d211dfe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:44.385038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943d6d0943814dc69a85dc004d211dfe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:44.396589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943d6d0943814dc69a85dc004d211dfe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:44.417523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1115/2245] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:44 2022] DELETE /identity/v3/users/943d6d0943814dc69a85dc004d211dfe => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:44.422971 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01eed-3149-46e4-9c34-33ee44e28290 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:44.423778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01eed-3149-46e4-9c34-33ee44e28290 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:44.424216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01eed-3149-46e4-9c34-33ee44e28290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:44.443596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-68f01eed-3149-46e4-9c34-33ee44e28290 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:44.445253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-68f01eed-3149-46e4-9c34-33ee44e28290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:44.502196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:44.503651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:44.573055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1131/2246] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:44.584128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f01eed-3149-46e4-9c34-33ee44e28290 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:44.585818 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-68f01eed-3149-46e4-9c34-33ee44e28290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:44.685787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:44.692760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d907f11-90fa-482f-82cf-ba1b86766b56 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:44.698693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:44.699911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:44.700267 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:44.700615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] PATH_INFO: `/v3/projects/df05070f4ae741e4b6aca85bd7122096` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:44.702972 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=df05070f4ae741e4b6aca85bd7122096)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:44.705056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:44.724884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f01eed-3149-46e4-9c34-33ee44e28290 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:44.772939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9b323-3582-43a0-abdc-7b0fe0c0053e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:44.778252 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b323-3582-43a0-abdc-7b0fe0c0053e service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:44.778712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b323-3582-43a0-abdc-7b0fe0c0053e service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:44.779165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b323-3582-43a0-abdc-7b0fe0c0053e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:44.822747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b323-3582-43a0-abdc-7b0fe0c0053e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:44.830470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b323-3582-43a0-abdc-7b0fe0c0053e service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:44.886611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1132/2247] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:32:44.887331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df05070f4ae741e4b6aca85bd7122096', 'request_id': 'req-9448a823-d80f-405b-bf48-8fb8904df27f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:44.907691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df05070f4ae741e4b6aca85bd7122096', 'request_id': 'req-9448a823-d80f-405b-bf48-8fb8904df27f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:44.921611 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df05070f4ae741e4b6aca85bd7122096', 'request_id': 'req-9448a823-d80f-405b-bf48-8fb8904df27f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:44.953197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] The token cache is being invalidate because project df05070f4ae741e4b6aca85bd7122096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:44.953482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:44.956551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9448a823-d80f-405b-bf48-8fb8904df27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:44.959135 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1116/2248] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:44 2022] DELETE /identity/v3/projects/df05070f4ae741e4b6aca85bd7122096 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:32:44.964269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1428-a7d4-4ace-8fb6-6b6c4f12f07b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:44.964934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1428-a7d4-4ace-8fb6-6b6c4f12f07b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:44.965391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1428-a7d4-4ace-8fb6-6b6c4f12f07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:44.996782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9e3f1428-a7d4-4ace-8fb6-6b6c4f12f07b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:44.998976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9e3f1428-a7d4-4ace-8fb6-6b6c4f12f07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:45.198434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1133/2249] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:45.206525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c416b-b295-4f2a-9ade-5c015a624402 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:45.207108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c416b-b295-4f2a-9ade-5c015a624402 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:45.207108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c416b-b295-4f2a-9ade-5c015a624402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:45.261901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-001c416b-b295-4f2a-9ade-5c015a624402 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:45.263162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-001c416b-b295-4f2a-9ade-5c015a624402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:45.265369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f1428-a7d4-4ace-8fb6-6b6c4f12f07b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:45.267463 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9e3f1428-a7d4-4ace-8fb6-6b6c4f12f07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:45.282628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f1428-a7d4-4ace-8fb6-6b6c4f12f07b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:45.294145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40090b9-338d-46f7-ba53-d5c3975ab314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:45.295973 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40090b9-338d-46f7-ba53-d5c3975ab314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:45.296509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40090b9-338d-46f7-ba53-d5c3975ab314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:45.297648 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40090b9-338d-46f7-ba53-d5c3975ab314 admin admin] PATH_INFO: `/v3/users/58434b0ebada488b9570c46f99935713` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:45.299500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40090b9-338d-46f7-ba53-d5c3975ab314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58434b0ebada488b9570c46f99935713)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:45.302434 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1117/2250] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:45.302809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40090b9-338d-46f7-ba53-d5c3975ab314 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:45.307021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c416b-b295-4f2a-9ade-5c015a624402 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:45.329723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:45.347046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c416b-b295-4f2a-9ade-5c015a624402 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:45.369167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39da90-1a79-4739-8a32-2fb8edfd3694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:45.369906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39da90-1a79-4739-8a32-2fb8edfd3694 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:45.370212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39da90-1a79-4739-8a32-2fb8edfd3694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:45.370493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39da90-1a79-4739-8a32-2fb8edfd3694 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:45.372934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39da90-1a79-4739-8a32-2fb8edfd3694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:45.373938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39da90-1a79-4739-8a32-2fb8edfd3694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:45.378433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39da90-1a79-4739-8a32-2fb8edfd3694 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:45.406714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b40090b9-338d-46f7-ba53-d5c3975ab314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58434b0ebada488b9570c46f99935713'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:45.426482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b40090b9-338d-46f7-ba53-d5c3975ab314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58434b0ebada488b9570c46f99935713'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:45.427712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b40090b9-338d-46f7-ba53-d5c3975ab314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58434b0ebada488b9570c46f99935713'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:45.438409 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1118/2251] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:45.439725 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39da90-1a79-4739-8a32-2fb8edfd3694 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:45.440975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b40090b9-338d-46f7-ba53-d5c3975ab314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58434b0ebada488b9570c46f99935713'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:45.453956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b40090b9-338d-46f7-ba53-d5c3975ab314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58434b0ebada488b9570c46f99935713'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:45.464492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1134/2252] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:45 2022] DELETE /identity/v3/users/58434b0ebada488b9570c46f99935713 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:45.469385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3620a0e-8f26-41ef-a147-55b3f95f6c53 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:45.470141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3620a0e-8f26-41ef-a147-55b3f95f6c53 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:45.470495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3620a0e-8f26-41ef-a147-55b3f95f6c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:45.486492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39da90-1a79-4739-8a32-2fb8edfd3694 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:45.500857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a3620a0e-8f26-41ef-a147-55b3f95f6c53 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:45.503120 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a3620a0e-8f26-41ef-a147-55b3f95f6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:45.590299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:45.618905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1135/2253] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:45.621695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3620a0e-8f26-41ef-a147-55b3f95f6c53 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:45.626970 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a3620a0e-8f26-41ef-a147-55b3f95f6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:45.658036 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c5ed8-23d5-4c31-8886-1e337dcc3219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:45.658504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5ed8-23d5-4c31-8886-1e337dcc3219 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:45.658788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5ed8-23d5-4c31-8886-1e337dcc3219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:45.659064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5ed8-23d5-4c31-8886-1e337dcc3219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:45.661243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c5ed8-23d5-4c31-8886-1e337dcc3219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:45.663194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c5ed8-23d5-4c31-8886-1e337dcc3219 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:45.684821 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3620a0e-8f26-41ef-a147-55b3f95f6c53 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:45.717666 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:45.720764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:45.721064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:45.721344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] PATH_INFO: `/v3/projects/0fc3c738a6d7435dbb8eaae960bff179` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:45.727328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc3c738a6d7435dbb8eaae960bff179)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:45.734580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:45.747014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1119/2254] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:45 2022] POST /identity/v3/projects => generated 369 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:45.747014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c5ed8-23d5-4c31-8886-1e337dcc3219 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:45.753147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2c4c5ed8-23d5-4c31-8886-1e337dcc3219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:45.855134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c5ed8-23d5-4c31-8886-1e337dcc3219 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:45.863395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc3c738a6d7435dbb8eaae960bff179', 'request_id': 'req-21bd550a-e388-4d12-a0f6-341f562ba618'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:45.890526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc3c738a6d7435dbb8eaae960bff179', 'request_id': 'req-21bd550a-e388-4d12-a0f6-341f562ba618'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:45.901014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc3c738a6d7435dbb8eaae960bff179', 'request_id': 'req-21bd550a-e388-4d12-a0f6-341f562ba618'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:45.935475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] The token cache is being invalidate because project 0fc3c738a6d7435dbb8eaae960bff179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:45.936148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:45.937196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:45.939332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1136/2255] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:45 2022] DELETE /identity/v3/projects/0fc3c738a6d7435dbb8eaae960bff179 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:45.940391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:45.943810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:45.982064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2579-9440-434a-967a-e3b232b9e3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:45.982829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2579-9440-434a-967a-e3b232b9e3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:45.983197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2579-9440-434a-967a-e3b232b9e3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:45.983537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2579-9440-434a-967a-e3b232b9e3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:45.986094 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7e8c2579-9440-434a-967a-e3b232b9e3c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:46.062876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd550a-e388-4d12-a0f6-341f562ba618 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:46.068689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2da5d-feb1-4105-b07c-4fc083c51fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:46.069159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2da5d-feb1-4105-b07c-4fc083c51fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.069443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2da5d-feb1-4105-b07c-4fc083c51fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.069716 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2da5d-feb1-4105-b07c-4fc083c51fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.070428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2da5d-feb1-4105-b07c-4fc083c51fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:46.072364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2da5d-feb1-4105-b07c-4fc083c51fa4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:46.083700 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:46.117400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c2579-9440-434a-967a-e3b232b9e3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:46.120005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c2579-9440-434a-967a-e3b232b9e3c3 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:46.130173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1137/2256] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:45 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:46.131779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd129-cad5-4507-a065-23bf555d1e62 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.132072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd129-cad5-4507-a065-23bf555d1e62 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.132363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd129-cad5-4507-a065-23bf555d1e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.133762 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1120/2257] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:46.134701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2579-9440-434a-967a-e3b232b9e3c3 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:46.147288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2579-9440-434a-967a-e3b232b9e3c3 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:46.158131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ff7f-3036-403d-8fc7-ec40a405e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:46.159139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ff7f-3036-403d-8fc7-ec40a405e55a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.159924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ff7f-3036-403d-8fc7-ec40a405e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.159924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ff7f-3036-403d-8fc7-ec40a405e55a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.160654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097ff7f-3036-403d-8fc7-ec40a405e55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:46.162732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097ff7f-3036-403d-8fc7-ec40a405e55a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:46.177752 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1121/2258] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:46.185754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ff7f-3036-403d-8fc7-ec40a405e55a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:46.188475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-57fcd129-cad5-4507-a065-23bf555d1e62 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:46.189744 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-57fcd129-cad5-4507-a065-23bf555d1e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:46.199382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ff7f-3036-403d-8fc7-ec40a405e55a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:46.208119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915d90d-924e-4a4c-b471-cd6999ba3712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:46.208785 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1138/2259] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:46.218910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02543061-654d-4892-810d-f5346ab7f77d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.219199 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02543061-654d-4892-810d-f5346ab7f77d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.219487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02543061-654d-4892-810d-f5346ab7f77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.224242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915d90d-924e-4a4c-b471-cd6999ba3712 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.224526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915d90d-924e-4a4c-b471-cd6999ba3712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.224799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915d90d-924e-4a4c-b471-cd6999ba3712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.225988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915d90d-924e-4a4c-b471-cd6999ba3712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:46.227759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915d90d-924e-4a4c-b471-cd6999ba3712 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:46.262848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1122/2260] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:46.264945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915d90d-924e-4a4c-b471-cd6999ba3712 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:46.281832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-02543061-654d-4892-810d-f5346ab7f77d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:46.284562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-02543061-654d-4892-810d-f5346ab7f77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:46.296932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915d90d-924e-4a4c-b471-cd6999ba3712 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:46.306271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd1b8e-4f03-4640-b641-720959944e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:46.308829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd1b8e-4f03-4640-b641-720959944e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.309423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd1b8e-4f03-4640-b641-720959944e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.310114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd1b8e-4f03-4640-b641-720959944e8f admin admin] PATH_INFO: `/v3/projects/04eea72e66d24107bbae94123f6904ee/users/9875ca655c084d9396c743254c8316f7/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.311377 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1139/2261] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:46.317696 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02543061-654d-4892-810d-f5346ab7f77d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:46.340459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02543061-654d-4892-810d-f5346ab7f77d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:46.341780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd1b8e-4f03-4640-b641-720959944e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04eea72e66d24107bbae94123f6904ee, user_id=9875ca655c084d9396c743254c8316f7, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:46.345912 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd1b8e-4f03-4640-b641-720959944e8f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:46.359374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc70de-bdd4-4a54-a0f9-725fd5d770ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:46.360279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc70de-bdd4-4a54-a0f9-725fd5d770ed admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.360407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc70de-bdd4-4a54-a0f9-725fd5d770ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.360691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc70de-bdd4-4a54-a0f9-725fd5d770ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.361507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc70de-bdd4-4a54-a0f9-725fd5d770ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:46.362191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc70de-bdd4-4a54-a0f9-725fd5d770ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:46.363845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc70de-bdd4-4a54-a0f9-725fd5d770ed admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:46.384913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1123/2262] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:46 2022] PUT /identity/v3/projects/04eea72e66d24107bbae94123f6904ee/users/9875ca655c084d9396c743254c8316f7/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:46.399559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1140/2263] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:46.401320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6783-d4b6-470e-9e97-cf13fd08a0ef None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.401717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6783-d4b6-470e-9e97-cf13fd08a0ef None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.406285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc70de-bdd4-4a54-a0f9-725fd5d770ed admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:46.407383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6783-d4b6-470e-9e97-cf13fd08a0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.433209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc70de-bdd4-4a54-a0f9-725fd5d770ed admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:46.480505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-57af6783-d4b6-470e-9e97-cf13fd08a0ef None None] MFA Rules not processed for user `9875ca655c084d9396c743254c8316f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:46.483177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-57af6783-d4b6-470e-9e97-cf13fd08a0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:46.492007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:46.524428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c812db-9131-45f9-978e-eb6f2d0210c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:46.525369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c812db-9131-45f9-978e-eb6f2d0210c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.525653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c812db-9131-45f9-978e-eb6f2d0210c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.525929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c812db-9131-45f9-978e-eb6f2d0210c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.528698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c812db-9131-45f9-978e-eb6f2d0210c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:46.535320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c812db-9131-45f9-978e-eb6f2d0210c1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:46.606945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1141/2264] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:46 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:46.608998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c812db-9131-45f9-978e-eb6f2d0210c1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:46.667325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1124/2265] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:46.672496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af6783-d4b6-470e-9e97-cf13fd08a0ef None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:46.700243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af6783-d4b6-470e-9e97-cf13fd08a0ef None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:46.760660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c812db-9131-45f9-978e-eb6f2d0210c1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:46.767051 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b6aa6-bd7d-4f21-bd83-d71ee033e461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:46.768217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b6aa6-bd7d-4f21-bd83-d71ee033e461 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.768917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b6aa6-bd7d-4f21-bd83-d71ee033e461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.769550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b6aa6-bd7d-4f21-bd83-d71ee033e461 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.770483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b6aa6-bd7d-4f21-bd83-d71ee033e461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:46.772722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b6aa6-bd7d-4f21-bd83-d71ee033e461 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:46.827658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1142/2266] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:46 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:46.828775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b6aa6-bd7d-4f21-bd83-d71ee033e461 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:46.832414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6b7b6aa6-bd7d-4f21-bd83-d71ee033e461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:46.834822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622e28b-29e1-457f-bbf1-2e9c0a7bd04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:46.856509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622e28b-29e1-457f-bbf1-2e9c0a7bd04f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.857418 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622e28b-29e1-457f-bbf1-2e9c0a7bd04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.857534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b6aa6-bd7d-4f21-bd83-d71ee033e461 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:46.857953 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622e28b-29e1-457f-bbf1-2e9c0a7bd04f admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.859266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622e28b-29e1-457f-bbf1-2e9c0a7bd04f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:46.863225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622e28b-29e1-457f-bbf1-2e9c0a7bd04f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:46.863793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:46.864801 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:46.865229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:46.865596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] PATH_INFO: `/v3/projects/019d7b6cb8b74a80b675ccf6ec2f3acd` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:46.866908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=019d7b6cb8b74a80b675ccf6ec2f3acd)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:46.869014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:46.901588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1125/2267] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:46 2022] POST /identity/v3/projects => generated 367 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:46.904883 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622e28b-29e1-457f-bbf1-2e9c0a7bd04f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:46.937062 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019d7b6cb8b74a80b675ccf6ec2f3acd', 'request_id': 'req-540949b7-0347-44b3-aea2-2928a98430ed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:46.941384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:46.954826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019d7b6cb8b74a80b675ccf6ec2f3acd', 'request_id': 'req-540949b7-0347-44b3-aea2-2928a98430ed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:46.966367 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019d7b6cb8b74a80b675ccf6ec2f3acd', 'request_id': 'req-540949b7-0347-44b3-aea2-2928a98430ed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:46.987135 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] The token cache is being invalidate because project 019d7b6cb8b74a80b675ccf6ec2f3acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:46.987449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:46.988288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:46.994551 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1143/2268] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:46 2022] DELETE /identity/v3/projects/019d7b6cb8b74a80b675ccf6ec2f3acd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:46.995599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:46.997289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:47.057282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:47.059301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622e28b-29e1-457f-bbf1-2e9c0a7bd04f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:47.092671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540949b7-0347-44b3-aea2-2928a98430ed admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:47.106936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7dfee-c10b-4817-aa4b-5eb6821d8732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:47.107841 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7dfee-c10b-4817-aa4b-5eb6821d8732 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:47.108131 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7dfee-c10b-4817-aa4b-5eb6821d8732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:47.109150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7dfee-c10b-4817-aa4b-5eb6821d8732 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:47.111063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7dfee-c10b-4817-aa4b-5eb6821d8732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:47.114348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7dfee-c10b-4817-aa4b-5eb6821d8732 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:47.168226 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1144/2269] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:46 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:47.169225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7dfee-c10b-4817-aa4b-5eb6821d8732 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:47.171156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22758e-5531-4a37-b430-b116bfaa9ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:47.171319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c1f7dfee-c10b-4817-aa4b-5eb6821d8732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:47.172134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22758e-5531-4a37-b430-b116bfaa9ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:47.172674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22758e-5531-4a37-b430-b116bfaa9ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:47.173120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22758e-5531-4a37-b430-b116bfaa9ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:47.174983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22758e-5531-4a37-b430-b116bfaa9ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:47.177106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22758e-5531-4a37-b430-b116bfaa9ffe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:47.188539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7dfee-c10b-4817-aa4b-5eb6821d8732 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:47.197576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1126/2270] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:47.198541 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:47.199102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22758e-5531-4a37-b430-b116bfaa9ffe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:47.199541 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:47.199828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:47.200110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] PATH_INFO: `/v3/users/775930813fa044aba22cc3ab6eb6285f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:47.201382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=775930813fa044aba22cc3ab6eb6285f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:47.203397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:47.215007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22758e-5531-4a37-b430-b116bfaa9ffe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:47.220969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23b715-99c6-4605-a4ef-278b14409660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:47.221657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b715-99c6-4605-a4ef-278b14409660 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:47.221938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b715-99c6-4605-a4ef-278b14409660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:47.222258 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b715-99c6-4605-a4ef-278b14409660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:47.223224 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23b715-99c6-4605-a4ef-278b14409660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:47.225271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23b715-99c6-4605-a4ef-278b14409660 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:47.240674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1127/2271] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:47.242760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23b715-99c6-4605-a4ef-278b14409660 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:47.246031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fe23b715-99c6-4605-a4ef-278b14409660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:47.274114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23b715-99c6-4605-a4ef-278b14409660 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:47.280080 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817428e7-236a-4163-8592-ffa45ed6e37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:47.281206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817428e7-236a-4163-8592-ffa45ed6e37f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:47.281490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817428e7-236a-4163-8592-ffa45ed6e37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:47.281765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817428e7-236a-4163-8592-ffa45ed6e37f admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:47.282607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817428e7-236a-4163-8592-ffa45ed6e37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:47.285357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817428e7-236a-4163-8592-ffa45ed6e37f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:47.292107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775930813fa044aba22cc3ab6eb6285f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:47.308841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1128/2272] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:47.310122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817428e7-236a-4163-8592-ffa45ed6e37f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:47.322141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775930813fa044aba22cc3ab6eb6285f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:47.323361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817428e7-236a-4163-8592-ffa45ed6e37f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:47.323943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775930813fa044aba22cc3ab6eb6285f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:47.332191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1c8b0-30a0-4275-a8f5-045aaf5f3809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:47.337321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1c8b0-30a0-4275-a8f5-045aaf5f3809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:47.337652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1c8b0-30a0-4275-a8f5-045aaf5f3809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:47.337873 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1c8b0-30a0-4275-a8f5-045aaf5f3809 admin admin] PATH_INFO: `/v3/projects/1a8b9bdd623c4d4189634e37c10303ef/users/cddf62d5183b4e14ade9522ad0d40ab6/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:47.344030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775930813fa044aba22cc3ab6eb6285f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:47.356243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775930813fa044aba22cc3ab6eb6285f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:47.373861 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1145/2273] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:47 2022] DELETE /identity/v3/users/775930813fa044aba22cc3ab6eb6285f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:47.377567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:47.379360 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:47.382029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1c8b0-30a0-4275-a8f5-045aaf5f3809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8b9bdd623c4d4189634e37c10303ef, user_id=cddf62d5183b4e14ade9522ad0d40ab6, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:47.385809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1c8b0-30a0-4275-a8f5-045aaf5f3809 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:47.434196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1129/2274] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:47 2022] PUT /identity/v3/projects/1a8b9bdd623c4d4189634e37c10303ef/users/cddf62d5183b4e14ade9522ad0d40ab6/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:47.435766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1c8b0-30a0-4275-a8f5-045aaf5f3809 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:47.438568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-31d1c8b0-30a0-4275-a8f5-045aaf5f3809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:47.545273 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1abf1-cdb6-4b6a-a932-32a5fbdcdd6f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:47.555083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1c8b0-30a0-4275-a8f5-045aaf5f3809 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:47.564845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1881a6e-5e69-4092-916f-2bbefb367a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:47.566092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1881a6e-5e69-4092-916f-2bbefb367a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:47.566685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1881a6e-5e69-4092-916f-2bbefb367a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:47.567310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810dde-fa8e-49e1-b995-a5f1b45bea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:47.567785 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1881a6e-5e69-4092-916f-2bbefb367a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:47.568829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810dde-fa8e-49e1-b995-a5f1b45bea65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:47.569156 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810dde-fa8e-49e1-b995-a5f1b45bea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:47.569433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810dde-fa8e-49e1-b995-a5f1b45bea65 admin admin] PATH_INFO: `/v3/projects/4970cd57f61d431da9fcce4addd2e4da/users/9f353c7234b4467b9f6f5f9063d660ed/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:47.569818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1881a6e-5e69-4092-916f-2bbefb367a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:47.572611 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1881a6e-5e69-4092-916f-2bbefb367a7a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:47.613045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59810dde-fa8e-49e1-b995-a5f1b45bea65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4970cd57f61d431da9fcce4addd2e4da, user_id=9f353c7234b4467b9f6f5f9063d660ed, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:47.613274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1130/2275] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:47.615099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1881a6e-5e69-4092-916f-2bbefb367a7a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:47.616359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59810dde-fa8e-49e1-b995-a5f1b45bea65 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:47.626858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:47.636712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1881a6e-5e69-4092-916f-2bbefb367a7a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:47.646998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2193086-a590-4548-b9a4-c3e19178dbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:47.647271 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1146/2276] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:47 2022] PUT /identity/v3/projects/4970cd57f61d431da9fcce4addd2e4da/users/9f353c7234b4467b9f6f5f9063d660ed/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:47.648623 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2193086-a590-4548-b9a4-c3e19178dbfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:47.649148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2193086-a590-4548-b9a4-c3e19178dbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:47.649586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2193086-a590-4548-b9a4-c3e19178dbfd admin admin] PATH_INFO: `/v3/projects/1a8b9bdd623c4d4189634e37c10303ef/users/cddf62d5183b4e14ade9522ad0d40ab6/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:47.657895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382d03f-c648-49bf-9110-bb20ef91e3a8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:47.658203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382d03f-c648-49bf-9110-bb20ef91e3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:47.658482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382d03f-c648-49bf-9110-bb20ef91e3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:47.677910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2193086-a590-4548-b9a4-c3e19178dbfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8b9bdd623c4d4189634e37c10303ef, user_id=cddf62d5183b4e14ade9522ad0d40ab6, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:47.685885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2193086-a590-4548-b9a4-c3e19178dbfd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:47.714327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a382d03f-c648-49bf-9110-bb20ef91e3a8 None None] MFA Rules not processed for user `9f353c7234b4467b9f6f5f9063d660ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:47.716372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a382d03f-c648-49bf-9110-bb20ef91e3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:47.737403 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:47.745775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1131/2277] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:47 2022] PUT /identity/v3/projects/1a8b9bdd623c4d4189634e37c10303ef/users/cddf62d5183b4e14ade9522ad0d40ab6/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:47.762853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8e2da-d95a-423a-893b-43a68051c42c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:47.763242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8e2da-d95a-423a-893b-43a68051c42c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:47.763529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8e2da-d95a-423a-893b-43a68051c42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:47.827577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-39d8e2da-d95a-423a-893b-43a68051c42c None None] MFA Rules not processed for user `cddf62d5183b4e14ade9522ad0d40ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:47.828905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-39d8e2da-d95a-423a-893b-43a68051c42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:47.881065 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1147/2278] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:32:47.892628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382d03f-c648-49bf-9110-bb20ef91e3a8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:47.894139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a382d03f-c648-49bf-9110-bb20ef91e3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:47.998831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1132/2279] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:48.000055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8e2da-d95a-423a-893b-43a68051c42c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:48.002201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-39d8e2da-d95a-423a-893b-43a68051c42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:48.016117 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382d03f-c648-49bf-9110-bb20ef91e3a8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:48.020582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c91b56-52eb-40f4-8a38-706ba3d3f453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:48.021302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c91b56-52eb-40f4-8a38-706ba3d3f453 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:48.021581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c91b56-52eb-40f4-8a38-706ba3d3f453 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:48.021874 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c91b56-52eb-40f4-8a38-706ba3d3f453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:48.035054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c91b56-52eb-40f4-8a38-706ba3d3f453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:48.037639 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c91b56-52eb-40f4-8a38-706ba3d3f453 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:48.048202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1148/2280] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:32:48.049133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c91b56-52eb-40f4-8a38-706ba3d3f453 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:48.050464 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-20c91b56-52eb-40f4-8a38-706ba3d3f453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:48.066234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c91b56-52eb-40f4-8a38-706ba3d3f453 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:48.070272 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5504d08-ff31-4163-bbeb-4b1b4bb1e117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:48.071008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5504d08-ff31-4163-bbeb-4b1b4bb1e117 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:48.071385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5504d08-ff31-4163-bbeb-4b1b4bb1e117 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:48.071734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5504d08-ff31-4163-bbeb-4b1b4bb1e117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:48.082743 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5504d08-ff31-4163-bbeb-4b1b4bb1e117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:48.084366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5504d08-ff31-4163-bbeb-4b1b4bb1e117 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:48.099197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1149/2281] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:48.100435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5504d08-ff31-4163-bbeb-4b1b4bb1e117 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:48.141862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8e2da-d95a-423a-893b-43a68051c42c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:48.153612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:48.163766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:48.163766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:48.163766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] PATH_INFO: `/v3/projects/da104a9610434a52b8cac9f48bf35937` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:48.166748 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da104a9610434a52b8cac9f48bf35937)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:48.168786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:48.237737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5504d08-ff31-4163-bbeb-4b1b4bb1e117 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:48.261822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da104a9610434a52b8cac9f48bf35937', 'request_id': 'req-0e1fb580-76ba-41c4-b220-07bff16b8e93'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.289664 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da104a9610434a52b8cac9f48bf35937', 'request_id': 'req-0e1fb580-76ba-41c4-b220-07bff16b8e93'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.302890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da104a9610434a52b8cac9f48bf35937', 'request_id': 'req-0e1fb580-76ba-41c4-b220-07bff16b8e93'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.319866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:48.328454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] The token cache is being invalidate because project da104a9610434a52b8cac9f48bf35937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:48.329126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.329588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.331252 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1133/2282] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:47 2022] DELETE /identity/v3/projects/da104a9610434a52b8cac9f48bf35937 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:48.335005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:48.338055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:48.341368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f36482-272d-42f3-b49c-f271b609530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:48.342262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f36482-272d-42f3-b49c-f271b609530f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:48.342646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f36482-272d-42f3-b49c-f271b609530f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:48.342881 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f36482-272d-42f3-b49c-f271b609530f admin admin] PATH_INFO: `/v3/users/9f353c7234b4467b9f6f5f9063d660ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:48.344997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f36482-272d-42f3-b49c-f271b609530f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f353c7234b4467b9f6f5f9063d660ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:48.346198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f36482-272d-42f3-b49c-f271b609530f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:48.356266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fb580-76ba-41c4-b220-07bff16b8e93 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:48.362370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:48.363584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:48.364593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:48.364593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] PATH_INFO: `/v3/users/ec6d56c3217444f691624fcc3c384c23` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:48.365730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec6d56c3217444f691624fcc3c384c23)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:48.368159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:48.370506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:48.492043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-41f36482-272d-42f3-b49c-f271b609530f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f353c7234b4467b9f6f5f9063d660ed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.526860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec6d56c3217444f691624fcc3c384c23'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.549722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-41f36482-272d-42f3-b49c-f271b609530f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f353c7234b4467b9f6f5f9063d660ed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.551727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-41f36482-272d-42f3-b49c-f271b609530f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f353c7234b4467b9f6f5f9063d660ed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.556417 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec6d56c3217444f691624fcc3c384c23'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.557457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec6d56c3217444f691624fcc3c384c23'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.558181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec6d56c3217444f691624fcc3c384c23'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.577137 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec6d56c3217444f691624fcc3c384c23'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.578032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-41f36482-272d-42f3-b49c-f271b609530f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f353c7234b4467b9f6f5f9063d660ed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.590365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-41f36482-272d-42f3-b49c-f271b609530f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f353c7234b4467b9f6f5f9063d660ed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:48.600866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1150/2283] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:48 2022] DELETE /identity/v3/users/9f353c7234b4467b9f6f5f9063d660ed => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:48.612469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1134/2284] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:48 2022] DELETE /identity/v3/users/ec6d56c3217444f691624fcc3c384c23 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:48.612986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e78ea-7411-4965-bbc6-0a48305c5f0b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:48.613294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e78ea-7411-4965-bbc6-0a48305c5f0b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:48.613560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e78ea-7411-4965-bbc6-0a48305c5f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:48.653617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2d6e78ea-7411-4965-bbc6-0a48305c5f0b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:48.657064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2d6e78ea-7411-4965-bbc6-0a48305c5f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:48.873607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1151/2285] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:48.882511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:48.883985 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:49.087112 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10357c8-1874-4181-ba80-d03dd2e99303 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:49.097109 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe2182-7d0c-4d56-a5cc-76f814e4afd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:49.099739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2182-7d0c-4d56-a5cc-76f814e4afd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:49.100224 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2182-7d0c-4d56-a5cc-76f814e4afd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:49.101408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2182-7d0c-4d56-a5cc-76f814e4afd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:49.123679 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe2182-7d0c-4d56-a5cc-76f814e4afd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:49.125412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe2182-7d0c-4d56-a5cc-76f814e4afd8 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:49.145395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1135/2286] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:49.303968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e336-790d-4d93-8fcb-eeecc83bd0bf None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:49.304523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e336-790d-4d93-8fcb-eeecc83bd0bf None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:49.304523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e336-790d-4d93-8fcb-eeecc83bd0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:49.350759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9b91e336-790d-4d93-8fcb-eeecc83bd0bf None None] MFA Rules not processed for user `379b9d83fdc741ba92fa198a3bc5f108`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:49.352689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9b91e336-790d-4d93-8fcb-eeecc83bd0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:49.442679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:49.451900 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1152/2287] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:49.456475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe2182-7d0c-4d56-a5cc-76f814e4afd8 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:49.460553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d4fe2182-7d0c-4d56-a5cc-76f814e4afd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:49.493891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe2182-7d0c-4d56-a5cc-76f814e4afd8 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:49.507876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fac6bc-b1f2-4190-91a5-5232180c4ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:49.509604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac6bc-b1f2-4190-91a5-5232180c4ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:49.510181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac6bc-b1f2-4190-91a5-5232180c4ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:49.511065 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac6bc-b1f2-4190-91a5-5232180c4ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:49.511955 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fac6bc-b1f2-4190-91a5-5232180c4ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:49.514510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fac6bc-b1f2-4190-91a5-5232180c4ff0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:49.519520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91e336-790d-4d93-8fcb-eeecc83bd0bf None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:49.521353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9b91e336-790d-4d93-8fcb-eeecc83bd0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:49.548441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91e336-790d-4d93-8fcb-eeecc83bd0bf None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:49.562418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:49.564421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:49.564603 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:49.564855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] PATH_INFO: `/v3/projects/77bf917369c94665b038825cdd7855a7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:49.570811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77bf917369c94665b038825cdd7855a7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:49.574038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:49.595126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1136/2288] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:49 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:49.600173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fac6bc-b1f2-4190-91a5-5232180c4ff0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:49.702600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77bf917369c94665b038825cdd7855a7', 'request_id': 'req-62b758d8-7f74-466f-adee-d3a72c536c8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:49.722808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77bf917369c94665b038825cdd7855a7', 'request_id': 'req-62b758d8-7f74-466f-adee-d3a72c536c8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:49.731121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77bf917369c94665b038825cdd7855a7', 'request_id': 'req-62b758d8-7f74-466f-adee-d3a72c536c8e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:49.743619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fac6bc-b1f2-4190-91a5-5232180c4ff0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:49.757337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:49.760700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] The token cache is being invalidate because project 77bf917369c94665b038825cdd7855a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:49.761030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:49.770097 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:49.777932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1153/2289] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:49 2022] DELETE /identity/v3/projects/77bf917369c94665b038825cdd7855a7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:49.860899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:49.862741 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:50.027726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522594f-db94-4336-b7d1-7fa126727b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:50.028863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522594f-db94-4336-b7d1-7fa126727b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:50.029319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522594f-db94-4336-b7d1-7fa126727b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:50.034789 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522594f-db94-4336-b7d1-7fa126727b74 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:50.036010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522594f-db94-4336-b7d1-7fa126727b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:50.038589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522594f-db94-4336-b7d1-7fa126727b74 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:50.095360 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1137/2290] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:49 2022] POST /identity/v3/users => generated 293 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:50.105819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522594f-db94-4336-b7d1-7fa126727b74 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:50.109006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f522594f-db94-4336-b7d1-7fa126727b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:50.115175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b758d8-7f74-466f-adee-d3a72c536c8e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:50.128805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:50.131428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:50.131842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:50.132237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] PATH_INFO: `/v3/projects/4970cd57f61d431da9fcce4addd2e4da` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:50.134138 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522594f-db94-4336-b7d1-7fa126727b74 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:50.134268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4970cd57f61d431da9fcce4addd2e4da)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:50.136810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:50.141573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd673ca-300b-4bc2-9252-e7788546116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:50.142764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd673ca-300b-4bc2-9252-e7788546116a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:50.143091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd673ca-300b-4bc2-9252-e7788546116a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:50.143377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd673ca-300b-4bc2-9252-e7788546116a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:50.144139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd673ca-300b-4bc2-9252-e7788546116a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:50.157246 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd673ca-300b-4bc2-9252-e7788546116a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:50.188108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1138/2291] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:50.189495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd673ca-300b-4bc2-9252-e7788546116a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:50.226041 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4970cd57f61d431da9fcce4addd2e4da', 'request_id': 'req-e52d795b-dbd3-45c5-aff9-1b332c170089'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:50.242791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4970cd57f61d431da9fcce4addd2e4da', 'request_id': 'req-e52d795b-dbd3-45c5-aff9-1b332c170089'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:50.243957 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd673ca-300b-4bc2-9252-e7788546116a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:50.260585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4970cd57f61d431da9fcce4addd2e4da', 'request_id': 'req-e52d795b-dbd3-45c5-aff9-1b332c170089'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:50.278757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] The token cache is being invalidate because project 4970cd57f61d431da9fcce4addd2e4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:50.279061 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:50.279884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:50.282523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1154/2292] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:49 2022] DELETE /identity/v3/projects/4970cd57f61d431da9fcce4addd2e4da => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:50.327576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac04b9-eee8-4301-924d-d50b8f1a3b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:50.328863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac04b9-eee8-4301-924d-d50b8f1a3b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:50.329714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac04b9-eee8-4301-924d-d50b8f1a3b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:50.330209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac04b9-eee8-4301-924d-d50b8f1a3b1b admin admin] PATH_INFO: `/v3/projects/fee7daf53f754373aa4b3583f389d19c/users/427647e667cb4434a334d21d084fe3e5/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:50.348543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac04b9-eee8-4301-924d-d50b8f1a3b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee7daf53f754373aa4b3583f389d19c, user_id=427647e667cb4434a334d21d084fe3e5, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:50.354007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac04b9-eee8-4301-924d-d50b8f1a3b1b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:50.378765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1139/2293] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:50 2022] PUT /identity/v3/projects/fee7daf53f754373aa4b3583f389d19c/users/427647e667cb4434a334d21d084fe3e5/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:50.382737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:50.384639 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:50.402748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d795b-dbd3-45c5-aff9-1b332c170089 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:50.418369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:50.506778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e7e9-fa2d-42fd-967f-8739aaac7990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:50.507784 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e7e9-fa2d-42fd-967f-8739aaac7990 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:50.508169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e7e9-fa2d-42fd-967f-8739aaac7990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:50.509146 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e7e9-fa2d-42fd-967f-8739aaac7990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:50.510489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e7e9-fa2d-42fd-967f-8739aaac7990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:50.526196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e7e9-fa2d-42fd-967f-8739aaac7990 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:50.547607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1155/2294] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:50.549087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac04b9-eee8-4301-924d-d50b8f1a3b1b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:50.565846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac04b9-eee8-4301-924d-d50b8f1a3b1b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:50.571757 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8fd26-dd78-48d1-97fd-aa22d0a6c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:50.572820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8fd26-dd78-48d1-97fd-aa22d0a6c1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:50.573199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8fd26-dd78-48d1-97fd-aa22d0a6c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:50.573542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8fd26-dd78-48d1-97fd-aa22d0a6c1b8 admin admin] PATH_INFO: `/v3/projects/fee7daf53f754373aa4b3583f389d19c/users/427647e667cb4434a334d21d084fe3e5/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:50.575681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8fd26-dd78-48d1-97fd-aa22d0a6c1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee7daf53f754373aa4b3583f389d19c, user_id=427647e667cb4434a334d21d084fe3e5, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:50.578792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8fd26-dd78-48d1-97fd-aa22d0a6c1b8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:50.600483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1140/2295] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:50 2022] PUT /identity/v3/projects/fee7daf53f754373aa4b3583f389d19c/users/427647e667cb4434a334d21d084fe3e5/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:50.710604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e7e9-fa2d-42fd-967f-8739aaac7990 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:50.712841 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-59f4e7e9-fa2d-42fd-967f-8739aaac7990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:50.740395 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e7e9-fa2d-42fd-967f-8739aaac7990 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:50.812139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:50.813767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:50.814175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:50.814526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] PATH_INFO: `/v3/users/9875ca655c084d9396c743254c8316f7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:50.816610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9875ca655c084d9396c743254c8316f7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:50.819406 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:50.896399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9875ca655c084d9396c743254c8316f7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:50.909537 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9875ca655c084d9396c743254c8316f7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:50.910527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9875ca655c084d9396c743254c8316f7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:50.921834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9875ca655c084d9396c743254c8316f7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:50.930349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9875ca655c084d9396c743254c8316f7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:50.937658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1156/2296] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:50 2022] DELETE /identity/v3/users/9875ca655c084d9396c743254c8316f7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:50.943113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20dc9-2788-4a70-9cf1-2db62aa386c5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:50.943307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20dc9-2788-4a70-9cf1-2db62aa386c5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:50.943573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20dc9-2788-4a70-9cf1-2db62aa386c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:50.962746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2cf20dc9-2788-4a70-9cf1-2db62aa386c5 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:50.965147 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2cf20dc9-2788-4a70-9cf1-2db62aa386c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:51.033493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:51.056637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1141/2297] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:51.067610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:51.069327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:51.143097 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:51.189086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa1cb6-5e2d-4279-806d-fee6f3a89464 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:51.193640 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8251140-69c6-43c2-9643-520764ba6ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:51.194539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8251140-69c6-43c2-9643-520764ba6ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:51.194825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8251140-69c6-43c2-9643-520764ba6ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:51.195125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8251140-69c6-43c2-9643-520764ba6ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:51.210592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8251140-69c6-43c2-9643-520764ba6ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:51.212611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8251140-69c6-43c2-9643-520764ba6ca3 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:51.229326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1157/2298] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:52.360673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf20dc9-2788-4a70-9cf1-2db62aa386c5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:52.374111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2cf20dc9-2788-4a70-9cf1-2db62aa386c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:52.391581 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf20dc9-2788-4a70-9cf1-2db62aa386c5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:52.397839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:52.399089 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:52.399615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:52.400305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] PATH_INFO: `/v3/projects/04eea72e66d24107bbae94123f6904ee` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:52.405779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] RBAC: Authorizing `identity:delete_project(project_id=04eea72e66d24107bbae94123f6904ee)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:52.408070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:52.551220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04eea72e66d24107bbae94123f6904ee', 'request_id': 'req-9da04d24-bc51-4af3-a9f6-a7f284af645b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:52.570906 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04eea72e66d24107bbae94123f6904ee', 'request_id': 'req-9da04d24-bc51-4af3-a9f6-a7f284af645b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:52.590510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04eea72e66d24107bbae94123f6904ee', 'request_id': 'req-9da04d24-bc51-4af3-a9f6-a7f284af645b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:52.627378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] The token cache is being invalidate because project 04eea72e66d24107bbae94123f6904ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:52.627943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:52.629385 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:52.639896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1142/2299] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:52 2022] DELETE /identity/v3/projects/04eea72e66d24107bbae94123f6904ee => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:52.644358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8251140-69c6-43c2-9643-520764ba6ca3 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:52.655231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8251140-69c6-43c2-9643-520764ba6ca3 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:52.821456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906c207-254a-4df6-9c69-a99fc7e8303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:52.823144 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906c207-254a-4df6-9c69-a99fc7e8303a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:52.823594 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906c207-254a-4df6-9c69-a99fc7e8303a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:52.824068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906c207-254a-4df6-9c69-a99fc7e8303a admin admin] PATH_INFO: `/v3/users/cddf62d5183b4e14ade9522ad0d40ab6` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:52.828182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906c207-254a-4df6-9c69-a99fc7e8303a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cddf62d5183b4e14ade9522ad0d40ab6)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:52.834298 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906c207-254a-4df6-9c69-a99fc7e8303a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:52.925582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f906c207-254a-4df6-9c69-a99fc7e8303a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cddf62d5183b4e14ade9522ad0d40ab6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:52.979319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f906c207-254a-4df6-9c69-a99fc7e8303a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cddf62d5183b4e14ade9522ad0d40ab6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:52.981046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f906c207-254a-4df6-9c69-a99fc7e8303a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cddf62d5183b4e14ade9522ad0d40ab6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:53.000560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f906c207-254a-4df6-9c69-a99fc7e8303a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cddf62d5183b4e14ade9522ad0d40ab6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:53.032178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f906c207-254a-4df6-9c69-a99fc7e8303a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cddf62d5183b4e14ade9522ad0d40ab6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:53.049900 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1158/2300] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:52 2022] DELETE /identity/v3/users/cddf62d5183b4e14ade9522ad0d40ab6 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:53.572066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:53.574301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:53.607971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da04d24-bc51-4af3-a9f6-a7f284af645b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:53.702632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:53.703836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:53.704279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:53.704711 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] PATH_INFO: `/v3/projects/1a8b9bdd623c4d4189634e37c10303ef` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:53.706184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8b9bdd623c4d4189634e37c10303ef)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:53.708475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:53.791014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8b9bdd623c4d4189634e37c10303ef', 'request_id': 'req-ecbf6813-5c96-4db8-bc71-36bc8070338e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:53.805214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8b9bdd623c4d4189634e37c10303ef', 'request_id': 'req-ecbf6813-5c96-4db8-bc71-36bc8070338e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:53.836567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8b9bdd623c4d4189634e37c10303ef', 'request_id': 'req-ecbf6813-5c96-4db8-bc71-36bc8070338e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:53.864079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] The token cache is being invalidate because project 1a8b9bdd623c4d4189634e37c10303ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:32:53.864369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:53.865885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ecbf6813-5c96-4db8-bc71-36bc8070338e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:53.880836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1143/2301] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:32:53 2022] DELETE /identity/v3/projects/1a8b9bdd623c4d4189634e37c10303ef => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:53.882704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1bf93-ba48-4649-8ed9-778492328ff9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:53.885249 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1bf93-ba48-4649-8ed9-778492328ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:53.897335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1bf93-ba48-4649-8ed9-778492328ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:53.935107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-72a1bf93-ba48-4649-8ed9-778492328ff9 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:53.936460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-72a1bf93-ba48-4649-8ed9-778492328ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:53.999155 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:54.043012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1159/2302] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:54.051909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0b6d8-6333-467a-a12e-9bc3df70127f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:54.052435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0b6d8-6333-467a-a12e-9bc3df70127f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:54.052891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0b6d8-6333-467a-a12e-9bc3df70127f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:54.096378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-99f0b6d8-6333-467a-a12e-9bc3df70127f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:54.097573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-99f0b6d8-6333-467a-a12e-9bc3df70127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:54.111159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1144/2303] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:54.116132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1bf93-ba48-4649-8ed9-778492328ff9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:54.130025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1bf93-ba48-4649-8ed9-778492328ff9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:54.135730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2c9c8-63a0-4634-b448-6bcb01a2beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:54.137004 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2c9c8-63a0-4634-b448-6bcb01a2beb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:54.137517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2c9c8-63a0-4634-b448-6bcb01a2beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:54.137983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2c9c8-63a0-4634-b448-6bcb01a2beb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:54.139487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2c9c8-63a0-4634-b448-6bcb01a2beb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:54.139996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2c9c8-63a0-4634-b448-6bcb01a2beb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:54.141866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2c9c8-63a0-4634-b448-6bcb01a2beb4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:54.167328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1160/2304] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:54.172047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0b6d8-6333-467a-a12e-9bc3df70127f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:54.176667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:54.184229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0b6d8-6333-467a-a12e-9bc3df70127f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:54.200486 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bf535-f07f-4fe0-86c6-f8dd559057ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:54.201557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bf535-f07f-4fe0-86c6-f8dd559057ff admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:54.201887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bf535-f07f-4fe0-86c6-f8dd559057ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:54.202288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bf535-f07f-4fe0-86c6-f8dd559057ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:54.203114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bf535-f07f-4fe0-86c6-f8dd559057ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:54.206630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bf535-f07f-4fe0-86c6-f8dd559057ff admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:54.261429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1145/2305] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:54 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:54.265993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2c9c8-63a0-4634-b448-6bcb01a2beb4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:54.286376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2c9c8-63a0-4634-b448-6bcb01a2beb4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:54.409892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2eff7-a0d9-4b8a-82cc-f6253de6e491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:54.410760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2eff7-a0d9-4b8a-82cc-f6253de6e491 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:54.411045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2eff7-a0d9-4b8a-82cc-f6253de6e491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:54.411327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2eff7-a0d9-4b8a-82cc-f6253de6e491 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:54.412043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2eff7-a0d9-4b8a-82cc-f6253de6e491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:54.414773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2eff7-a0d9-4b8a-82cc-f6253de6e491 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:54.445066 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1161/2306] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:54 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:54.449268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bf535-f07f-4fe0-86c6-f8dd559057ff admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:54.466470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bf535-f07f-4fe0-86c6-f8dd559057ff admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:54.479855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abd7b5-45f6-4d67-8de7-20a7c0e2128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:54.480597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abd7b5-45f6-4d67-8de7-20a7c0e2128d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:54.480876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abd7b5-45f6-4d67-8de7-20a7c0e2128d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:54.481201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abd7b5-45f6-4d67-8de7-20a7c0e2128d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:54.481965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abd7b5-45f6-4d67-8de7-20a7c0e2128d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:54.483588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abd7b5-45f6-4d67-8de7-20a7c0e2128d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:54.502865 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1146/2307] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:54.504246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2eff7-a0d9-4b8a-82cc-f6253de6e491 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:54.520521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2eff7-a0d9-4b8a-82cc-f6253de6e491 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:54.531438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afb108-b04e-40ba-8d43-9ae398679929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:54.532837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afb108-b04e-40ba-8d43-9ae398679929 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:54.533171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afb108-b04e-40ba-8d43-9ae398679929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:54.533450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afb108-b04e-40ba-8d43-9ae398679929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:54.536762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afb108-b04e-40ba-8d43-9ae398679929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:54.538562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afb108-b04e-40ba-8d43-9ae398679929 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:54.564721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1162/2308] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:54.569350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abd7b5-45f6-4d67-8de7-20a7c0e2128d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:54.580248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abd7b5-45f6-4d67-8de7-20a7c0e2128d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:54.588741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634cc74-2416-45ae-8990-b901479add15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:54.589746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634cc74-2416-45ae-8990-b901479add15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:54.590023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634cc74-2416-45ae-8990-b901479add15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:54.590461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634cc74-2416-45ae-8990-b901479add15 admin admin] PATH_INFO: `/v3/projects/e8c749e219d0443e926b07fc360849d2/users/787577cdbb2e41e4bbf37e3d43c00df9/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:54.610798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634cc74-2416-45ae-8990-b901479add15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c749e219d0443e926b07fc360849d2, user_id=787577cdbb2e41e4bbf37e3d43c00df9, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:54.614166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634cc74-2416-45ae-8990-b901479add15 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:54.633459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1147/2309] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:54 2022] PUT /identity/v3/projects/e8c749e219d0443e926b07fc360849d2/users/787577cdbb2e41e4bbf37e3d43c00df9/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:54.651549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289818d-7ea8-4bf4-b2f1-76973f7273e3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:54.651549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289818d-7ea8-4bf4-b2f1-76973f7273e3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:54.651892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289818d-7ea8-4bf4-b2f1-76973f7273e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:54.704705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b289818d-7ea8-4bf4-b2f1-76973f7273e3 None None] MFA Rules not processed for user `787577cdbb2e41e4bbf37e3d43c00df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:54.706322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b289818d-7ea8-4bf4-b2f1-76973f7273e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:54.787042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1163/2310] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:54.791503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634cc74-2416-45ae-8990-b901479add15 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:54.871234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634cc74-2416-45ae-8990-b901479add15 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:54.876739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1565-6bda-4189-9832-0b8832768b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:54.877458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1565-6bda-4189-9832-0b8832768b88 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:54.877796 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1565-6bda-4189-9832-0b8832768b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:54.878021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1565-6bda-4189-9832-0b8832768b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:54.878678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a1565-6bda-4189-9832-0b8832768b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:54.880792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a1565-6bda-4189-9832-0b8832768b88 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:54.915492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1148/2311] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:32:54 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:32:54.919518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289818d-7ea8-4bf4-b2f1-76973f7273e3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:54.936253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289818d-7ea8-4bf4-b2f1-76973f7273e3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:55.012880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:55.030862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1910ed-6bdc-4a78-9652-06911b5124c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:55.031855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1910ed-6bdc-4a78-9652-06911b5124c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:55.033049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1910ed-6bdc-4a78-9652-06911b5124c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:55.033166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1910ed-6bdc-4a78-9652-06911b5124c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:55.034705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1910ed-6bdc-4a78-9652-06911b5124c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:55.036797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1910ed-6bdc-4a78-9652-06911b5124c0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:55.089894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1164/2312] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:32:54 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:55.091630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1565-6bda-4189-9832-0b8832768b88 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:55.109017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1565-6bda-4189-9832-0b8832768b88 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:55.120910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547d1b4-4fce-49f8-b8ac-3dbfd2734d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:55.121659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d1b4-4fce-49f8-b8ac-3dbfd2734d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:55.121979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d1b4-4fce-49f8-b8ac-3dbfd2734d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:55.122436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d1b4-4fce-49f8-b8ac-3dbfd2734d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:55.123591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547d1b4-4fce-49f8-b8ac-3dbfd2734d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:55.126127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547d1b4-4fce-49f8-b8ac-3dbfd2734d5f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:55.144658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1149/2313] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:55.145799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1910ed-6bdc-4a78-9652-06911b5124c0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:55.175810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1910ed-6bdc-4a78-9652-06911b5124c0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:55.185270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa308-0ccb-42ba-96e5-b802db8221bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:55.186259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa308-0ccb-42ba-96e5-b802db8221bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:55.186543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa308-0ccb-42ba-96e5-b802db8221bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:55.186906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa308-0ccb-42ba-96e5-b802db8221bf admin admin] PATH_INFO: `/v3/projects/95ec0799994f4f5c9a55ed5bde9e75d5/users/f8e20af2177f487fbec853c8685777a6/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:55.228344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fa308-0ccb-42ba-96e5-b802db8221bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ec0799994f4f5c9a55ed5bde9e75d5, user_id=f8e20af2177f487fbec853c8685777a6, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:55.232000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fa308-0ccb-42ba-96e5-b802db8221bf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:55.253859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1165/2314] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:55 2022] PUT /identity/v3/projects/95ec0799994f4f5c9a55ed5bde9e75d5/users/f8e20af2177f487fbec853c8685777a6/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:55.257683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547d1b4-4fce-49f8-b8ac-3dbfd2734d5f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:55.268201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547d1b4-4fce-49f8-b8ac-3dbfd2734d5f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:55.332457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dec8d-a37b-4c53-8077-62130e0a7ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:55.333173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dec8d-a37b-4c53-8077-62130e0a7ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:55.333461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dec8d-a37b-4c53-8077-62130e0a7ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:55.333732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dec8d-a37b-4c53-8077-62130e0a7ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:55.334457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dec8d-a37b-4c53-8077-62130e0a7ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:55.336125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dec8d-a37b-4c53-8077-62130e0a7ee0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:55.348058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1150/2315] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:55.352338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa308-0ccb-42ba-96e5-b802db8221bf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:55.375407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa308-0ccb-42ba-96e5-b802db8221bf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:55.384984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f336b46-b54c-4409-b38a-2a873bf21f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:55.386230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f336b46-b54c-4409-b38a-2a873bf21f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:55.387438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f336b46-b54c-4409-b38a-2a873bf21f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:55.387714 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f336b46-b54c-4409-b38a-2a873bf21f42 admin admin] PATH_INFO: `/v3/projects/95ec0799994f4f5c9a55ed5bde9e75d5/users/f8e20af2177f487fbec853c8685777a6/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:55.389752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f336b46-b54c-4409-b38a-2a873bf21f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ec0799994f4f5c9a55ed5bde9e75d5, user_id=f8e20af2177f487fbec853c8685777a6, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:55.393334 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f336b46-b54c-4409-b38a-2a873bf21f42 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:55.426461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee72ea-889b-44b8-8d16-c76e01d6f82e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:55.426778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee72ea-889b-44b8-8d16-c76e01d6f82e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:55.427190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee72ea-889b-44b8-8d16-c76e01d6f82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:55.428640 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1166/2316] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:32:55 2022] PUT /identity/v3/projects/95ec0799994f4f5c9a55ed5bde9e75d5/users/f8e20af2177f487fbec853c8685777a6/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:55.482742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-81ee72ea-889b-44b8-8d16-c76e01d6f82e None None] MFA Rules not processed for user `f8e20af2177f487fbec853c8685777a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:55.484833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-81ee72ea-889b-44b8-8d16-c76e01d6f82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:55.500480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:55.593914 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1151/2317] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:55.605935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f336b46-b54c-4409-b38a-2a873bf21f42 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:55.607733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2f336b46-b54c-4409-b38a-2a873bf21f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:55.690808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f336b46-b54c-4409-b38a-2a873bf21f42 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:55.695975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efbfd8-b4b8-45ac-a9f3-be6881d800a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:55.696650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efbfd8-b4b8-45ac-a9f3-be6881d800a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:55.696933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efbfd8-b4b8-45ac-a9f3-be6881d800a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:55.697240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efbfd8-b4b8-45ac-a9f3-be6881d800a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:55.708614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efbfd8-b4b8-45ac-a9f3-be6881d800a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:55.710101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efbfd8-b4b8-45ac-a9f3-be6881d800a5 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:55.725205 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1167/2318] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:55 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:55.777024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee72ea-889b-44b8-8d16-c76e01d6f82e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:55.779136 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-81ee72ea-889b-44b8-8d16-c76e01d6f82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:55.794339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee72ea-889b-44b8-8d16-c76e01d6f82e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:55.798868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3fed-48d6-472e-9403-f1e9806e4003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:55.800083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3fed-48d6-472e-9403-f1e9806e4003 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:55.800083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3fed-48d6-472e-9403-f1e9806e4003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:55.800331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3fed-48d6-472e-9403-f1e9806e4003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:55.893282 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d3fed-48d6-472e-9403-f1e9806e4003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:55.895331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d3fed-48d6-472e-9403-f1e9806e4003 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:55.909346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1152/2319] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:56.334008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fa92-e6e6-4902-984b-a3935f1ff0f2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:56.334655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fa92-e6e6-4902-984b-a3935f1ff0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:56.334655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fa92-e6e6-4902-984b-a3935f1ff0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:56.370891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8416fa92-e6e6-4902-984b-a3935f1ff0f2 None None] MFA Rules not processed for user `427647e667cb4434a334d21d084fe3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:56.372385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8416fa92-e6e6-4902-984b-a3935f1ff0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:56.526178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1168/2320] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:56.739150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3fed-48d6-472e-9403-f1e9806e4003 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:56.740744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-838d3fed-48d6-472e-9403-f1e9806e4003 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:56.838191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3fed-48d6-472e-9403-f1e9806e4003 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:56.843826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a4bdf-5a97-430a-bff0-a1c3cbbf9a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:56.844502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a4bdf-5a97-430a-bff0-a1c3cbbf9a4d service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:56.844781 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a4bdf-5a97-430a-bff0-a1c3cbbf9a4d service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:56.845090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a4bdf-5a97-430a-bff0-a1c3cbbf9a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:56.846938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-241a4bdf-5a97-430a-bff0-a1c3cbbf9a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:56.883595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:56.915544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a4bdf-5a97-430a-bff0-a1c3cbbf9a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:56.917296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a4bdf-5a97-430a-bff0-a1c3cbbf9a4d service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:56.927140 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1153/2321] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:32:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:32:58.116393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121f474-0328-4ec7-8c6d-50d220290c06 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:58.116813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121f474-0328-4ec7-8c6d-50d220290c06 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:58.116949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121f474-0328-4ec7-8c6d-50d220290c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:58.135397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2121f474-0328-4ec7-8c6d-50d220290c06 None None] MFA Rules not processed for user `379b9d83fdc741ba92fa198a3bc5f108`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:58.136637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2121f474-0328-4ec7-8c6d-50d220290c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:58.148429 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1169/2322] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:32:59.775388 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a4bdf-5a97-430a-bff0-a1c3cbbf9a4d service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:59.845222 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a4bdf-5a97-430a-bff0-a1c3cbbf9a4d service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:59.850631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:59.851520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:59.851794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:59.852064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] PATH_INFO: `/v3/users/787577cdbb2e41e4bbf37e3d43c00df9` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:59.853408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=787577cdbb2e41e4bbf37e3d43c00df9)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:59.855515 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:59.906719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787577cdbb2e41e4bbf37e3d43c00df9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:59.919745 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787577cdbb2e41e4bbf37e3d43c00df9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:59.920493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787577cdbb2e41e4bbf37e3d43c00df9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:59.921181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787577cdbb2e41e4bbf37e3d43c00df9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:59.930182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787577cdbb2e41e4bbf37e3d43c00df9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:32:59.944002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1154/2323] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:32:59 2022] DELETE /identity/v3/users/787577cdbb2e41e4bbf37e3d43c00df9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:59.948841 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bead297-4930-413c-8c84-282c5d4bf603 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:59.949524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bead297-4930-413c-8c84-282c5d4bf603 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:59.949524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bead297-4930-413c-8c84-282c5d4bf603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:59.968062 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1bead297-4930-413c-8c84-282c5d4bf603 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:59.969358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1bead297-4930-413c-8c84-282c5d4bf603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:59.984265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:00.033917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1170/2324] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:00.044353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:00.046024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:00.106155 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a71f97-af57-412b-ba78-ddf09e07f7d4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:00.110574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab9b66-daf0-499e-9bf8-794df29a2621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:00.111576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab9b66-daf0-499e-9bf8-794df29a2621 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:00.111853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab9b66-daf0-499e-9bf8-794df29a2621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:00.112120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab9b66-daf0-499e-9bf8-794df29a2621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:00.121879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab9b66-daf0-499e-9bf8-794df29a2621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:00.123331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab9b66-daf0-499e-9bf8-794df29a2621 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:00.127357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:00.134482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1155/2325] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:33:00.353620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb6465-d9af-437d-b563-5aa87b2f579c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:00.353906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb6465-d9af-437d-b563-5aa87b2f579c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:00.354179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb6465-d9af-437d-b563-5aa87b2f579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:00.380902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-06cb6465-d9af-437d-b563-5aa87b2f579c None None] MFA Rules not processed for user `e23fcb16b89d4fe6a6f03466f8d0d575`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:00.382253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-06cb6465-d9af-437d-b563-5aa87b2f579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:00.437993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab9b66-daf0-499e-9bf8-794df29a2621 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:00.440205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-37ab9b66-daf0-499e-9bf8-794df29a2621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:00.447956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1171/2326] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:00.456487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab9b66-daf0-499e-9bf8-794df29a2621 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:00.502377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:00.503809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:00.504852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:00.505155 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] PATH_INFO: `/v3/projects/e8c749e219d0443e926b07fc360849d2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:00.509461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c749e219d0443e926b07fc360849d2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:00.511464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:00.582845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c749e219d0443e926b07fc360849d2', 'request_id': 'req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:00.592204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c749e219d0443e926b07fc360849d2', 'request_id': 'req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:00.599191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c749e219d0443e926b07fc360849d2', 'request_id': 'req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:00.619107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] The token cache is being invalidate because project e8c749e219d0443e926b07fc360849d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:33:00.619468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:00.620483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:00.627451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb6465-d9af-437d-b563-5aa87b2f579c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:00.627843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1156/2327] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:33:00 2022] DELETE /identity/v3/projects/e8c749e219d0443e926b07fc360849d2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:33:00.647986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb6465-d9af-437d-b563-5aa87b2f579c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:00.732238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dad970-b598-462b-9b0f-b54f64b30b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:00.733068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad970-b598-462b-9b0f-b54f64b30b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:00.733353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad970-b598-462b-9b0f-b54f64b30b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:00.733629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad970-b598-462b-9b0f-b54f64b30b01 admin admin] PATH_INFO: `/v3/users/f8e20af2177f487fbec853c8685777a6` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:00.734866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dad970-b598-462b-9b0f-b54f64b30b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e20af2177f487fbec853c8685777a6)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:00.737392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dad970-b598-462b-9b0f-b54f64b30b01 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:00.809327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-07dad970-b598-462b-9b0f-b54f64b30b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e20af2177f487fbec853c8685777a6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:00.842798 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-07dad970-b598-462b-9b0f-b54f64b30b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e20af2177f487fbec853c8685777a6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:00.843583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-07dad970-b598-462b-9b0f-b54f64b30b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e20af2177f487fbec853c8685777a6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:00.846678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:00.854636 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-07dad970-b598-462b-9b0f-b54f64b30b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e20af2177f487fbec853c8685777a6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:00.866321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-07dad970-b598-462b-9b0f-b54f64b30b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e20af2177f487fbec853c8685777a6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:00.878734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1172/2328] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:33:00 2022] DELETE /identity/v3/users/f8e20af2177f487fbec853c8685777a6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:01.308368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:01.309551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:01.330797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b796e-79d1-4fd2-89b8-5fc20d7037b5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:01.429882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:01.430963 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:01.431317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:01.431661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] PATH_INFO: `/v3/projects/95ec0799994f4f5c9a55ed5bde9e75d5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:01.433029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ec0799994f4f5c9a55ed5bde9e75d5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:01.435184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:01.504998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ec0799994f4f5c9a55ed5bde9e75d5', 'request_id': 'req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:01.518619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ec0799994f4f5c9a55ed5bde9e75d5', 'request_id': 'req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:01.526069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ec0799994f4f5c9a55ed5bde9e75d5', 'request_id': 'req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:01.539314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] The token cache is being invalidate because project 95ec0799994f4f5c9a55ed5bde9e75d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:33:01.539786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:01.540500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a2f0b12-e814-4a25-b0e8-e1b75e2963a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:01.545932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1157/2329] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:33:01 2022] DELETE /identity/v3/projects/95ec0799994f4f5c9a55ed5bde9e75d5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:01.548292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20618d-15f8-4d29-bec3-c473fd41c612 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:01.548856 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20618d-15f8-4d29-bec3-c473fd41c612 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:01.549079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20618d-15f8-4d29-bec3-c473fd41c612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:01.581517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1a20618d-15f8-4d29-bec3-c473fd41c612 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:01.582724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1a20618d-15f8-4d29-bec3-c473fd41c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:01.679854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1173/2330] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:01.681609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2a84-8cf7-4db5-9a2e-fc15f11df5d1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:01.681609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2a84-8cf7-4db5-9a2e-fc15f11df5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:01.681801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2a84-8cf7-4db5-9a2e-fc15f11df5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:01.717950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-686d2a84-8cf7-4db5-9a2e-fc15f11df5d1 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:01.719400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-686d2a84-8cf7-4db5-9a2e-fc15f11df5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:01.739963 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1158/2331] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:33:01.743977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20618d-15f8-4d29-bec3-c473fd41c612 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:01.761032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20618d-15f8-4d29-bec3-c473fd41c612 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:01.779607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48d3eb-7cd2-4614-8cf7-773f17828504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:01.780312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d3eb-7cd2-4614-8cf7-773f17828504 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:01.780587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d3eb-7cd2-4614-8cf7-773f17828504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:01.786532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d3eb-7cd2-4614-8cf7-773f17828504 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:01.787614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48d3eb-7cd2-4614-8cf7-773f17828504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:33:01.787924 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48d3eb-7cd2-4614-8cf7-773f17828504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:01.799360 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48d3eb-7cd2-4614-8cf7-773f17828504 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:01.882336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1174/2332] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:33:01.888001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d2a84-8cf7-4db5-9a2e-fc15f11df5d1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:01.894244 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:01.899213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d2a84-8cf7-4db5-9a2e-fc15f11df5d1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:01.911328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d770cb7-f71c-44ab-942f-55b575e9effe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:01.914998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d770cb7-f71c-44ab-942f-55b575e9effe admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:01.915939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d770cb7-f71c-44ab-942f-55b575e9effe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:01.916402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d770cb7-f71c-44ab-942f-55b575e9effe admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:01.917206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d770cb7-f71c-44ab-942f-55b575e9effe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:01.919309 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d770cb7-f71c-44ab-942f-55b575e9effe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:02.002840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1159/2333] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:33:01 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:33:02.007306 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48d3eb-7cd2-4614-8cf7-773f17828504 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:02.030003 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48d3eb-7cd2-4614-8cf7-773f17828504 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:02.132429 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09af32-ff08-41bb-abed-0fedbe5c623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:02.135511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09af32-ff08-41bb-abed-0fedbe5c623f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:02.136107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09af32-ff08-41bb-abed-0fedbe5c623f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:02.136583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09af32-ff08-41bb-abed-0fedbe5c623f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:02.137600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09af32-ff08-41bb-abed-0fedbe5c623f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:02.140670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09af32-ff08-41bb-abed-0fedbe5c623f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:02.174525 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1175/2334] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:33:02 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:33:02.178808 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d770cb7-f71c-44ab-942f-55b575e9effe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:02.207465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d770cb7-f71c-44ab-942f-55b575e9effe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:02.220204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3882-9c93-4330-8f84-c093d76befeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:02.221471 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3882-9c93-4330-8f84-c093d76befeb admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:02.221839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3882-9c93-4330-8f84-c093d76befeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:02.222339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3882-9c93-4330-8f84-c093d76befeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:02.223530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d3882-9c93-4330-8f84-c093d76befeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:02.226899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d3882-9c93-4330-8f84-c093d76befeb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:02.246760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1160/2335] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:02.249088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09af32-ff08-41bb-abed-0fedbe5c623f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:02.270075 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09af32-ff08-41bb-abed-0fedbe5c623f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:02.275761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248b4d0-7206-426d-b7a2-43ad73d8adfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:02.277110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248b4d0-7206-426d-b7a2-43ad73d8adfe admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:02.277598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248b4d0-7206-426d-b7a2-43ad73d8adfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:02.277928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248b4d0-7206-426d-b7a2-43ad73d8adfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:02.278775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248b4d0-7206-426d-b7a2-43ad73d8adfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:02.280611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248b4d0-7206-426d-b7a2-43ad73d8adfe admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:02.301010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1176/2336] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:02.304533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3882-9c93-4330-8f84-c093d76befeb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:02.324734 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3882-9c93-4330-8f84-c093d76befeb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:02.332519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3ecef-19d1-4de9-aa1d-bcc575ee46d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:02.333950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3ecef-19d1-4de9-aa1d-bcc575ee46d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:02.334452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3ecef-19d1-4de9-aa1d-bcc575ee46d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:02.334876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3ecef-19d1-4de9-aa1d-bcc575ee46d3 admin admin] PATH_INFO: `/v3/projects/d8b7cb433cbc42319b4fa4f172c96678/users/36c1dee2e9c549cb881ec1a206f90247/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:02.353456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3ecef-19d1-4de9-aa1d-bcc575ee46d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b7cb433cbc42319b4fa4f172c96678, user_id=36c1dee2e9c549cb881ec1a206f90247, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:02.356124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3ecef-19d1-4de9-aa1d-bcc575ee46d3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:02.387584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1161/2337] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:33:02 2022] PUT /identity/v3/projects/d8b7cb433cbc42319b4fa4f172c96678/users/36c1dee2e9c549cb881ec1a206f90247/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:02.398368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03158d-c9b6-4bdb-9b92-6d7330bc172f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:02.398368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03158d-c9b6-4bdb-9b92-6d7330bc172f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:02.398607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03158d-c9b6-4bdb-9b92-6d7330bc172f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:02.442613 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ba03158d-c9b6-4bdb-9b92-6d7330bc172f None None] MFA Rules not processed for user `36c1dee2e9c549cb881ec1a206f90247`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:02.443933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ba03158d-c9b6-4bdb-9b92-6d7330bc172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:02.502376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:02.542941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1177/2338] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:02.545289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3ecef-19d1-4de9-aa1d-bcc575ee46d3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:02.653181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3ecef-19d1-4de9-aa1d-bcc575ee46d3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:02.665765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f5af5-6cc9-43ab-a89c-9da7c76d930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:02.673048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f5af5-6cc9-43ab-a89c-9da7c76d930c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:02.673817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f5af5-6cc9-43ab-a89c-9da7c76d930c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:02.674237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f5af5-6cc9-43ab-a89c-9da7c76d930c admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:02.675323 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f5af5-6cc9-43ab-a89c-9da7c76d930c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:02.677640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f5af5-6cc9-43ab-a89c-9da7c76d930c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:02.718585 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1162/2339] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:33:02 2022] POST /identity/v3/projects => generated 391 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:33:02.722569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03158d-c9b6-4bdb-9b92-6d7330bc172f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:02.735539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03158d-c9b6-4bdb-9b92-6d7330bc172f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:02.811557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1118e53-11c8-40e8-9f47-8440b517b94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:02.812550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1118e53-11c8-40e8-9f47-8440b517b94e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:02.813081 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1118e53-11c8-40e8-9f47-8440b517b94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:02.813357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1118e53-11c8-40e8-9f47-8440b517b94e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:02.814104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1118e53-11c8-40e8-9f47-8440b517b94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:02.816048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1118e53-11c8-40e8-9f47-8440b517b94e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:02.845000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1178/2340] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:33:02 2022] POST /identity/v3/users => generated 302 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:33:02.847685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f5af5-6cc9-43ab-a89c-9da7c76d930c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:02.866501 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f5af5-6cc9-43ab-a89c-9da7c76d930c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:02.872089 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457af94-6d5b-46a3-8b2d-24ccc9d52fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:02.872934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457af94-6d5b-46a3-8b2d-24ccc9d52fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:02.873329 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457af94-6d5b-46a3-8b2d-24ccc9d52fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:02.873726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457af94-6d5b-46a3-8b2d-24ccc9d52fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:02.874582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457af94-6d5b-46a3-8b2d-24ccc9d52fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:02.876527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457af94-6d5b-46a3-8b2d-24ccc9d52fe9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:02.898559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1163/2341] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:02.902384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1118e53-11c8-40e8-9f47-8440b517b94e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:02.931207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1118e53-11c8-40e8-9f47-8440b517b94e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:02.937297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8b4db-15e9-4e35-b9c7-bd7a7359648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:02.938441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8b4db-15e9-4e35-b9c7-bd7a7359648d admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:02.938732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8b4db-15e9-4e35-b9c7-bd7a7359648d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:02.939015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8b4db-15e9-4e35-b9c7-bd7a7359648d admin admin] PATH_INFO: `/v3/projects/629b338976444aae997126e09a847471/users/f8b4cee22ae64306840c2277670f87be/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:02.955933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8b4db-15e9-4e35-b9c7-bd7a7359648d admin admin] RBAC: Authorizing `identity:create_grant(project_id=629b338976444aae997126e09a847471, user_id=f8b4cee22ae64306840c2277670f87be, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:02.958681 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8b4db-15e9-4e35-b9c7-bd7a7359648d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:02.973191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1179/2342] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:33:02 2022] PUT /identity/v3/projects/629b338976444aae997126e09a847471/users/f8b4cee22ae64306840c2277670f87be/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:33:02.977421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457af94-6d5b-46a3-8b2d-24ccc9d52fe9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:02.988693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457af94-6d5b-46a3-8b2d-24ccc9d52fe9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:03.047553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8d3e0-e032-4bb9-b9c4-756f17908df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:03.048138 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d3e0-e032-4bb9-b9c4-756f17908df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:03.048473 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d3e0-e032-4bb9-b9c4-756f17908df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:03.048886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d3e0-e032-4bb9-b9c4-756f17908df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:03.049878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d3e0-e032-4bb9-b9c4-756f17908df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:03.051679 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d3e0-e032-4bb9-b9c4-756f17908df3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:03.074638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1164/2343] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:03.076046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8b4db-15e9-4e35-b9c7-bd7a7359648d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:03.090010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8b4db-15e9-4e35-b9c7-bd7a7359648d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:03.100975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e6cdc-9074-40d3-b153-32aae01a3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:03.100975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e6cdc-9074-40d3-b153-32aae01a3d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:03.100975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e6cdc-9074-40d3-b153-32aae01a3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:03.100975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e6cdc-9074-40d3-b153-32aae01a3d57 admin admin] PATH_INFO: `/v3/projects/629b338976444aae997126e09a847471/users/f8b4cee22ae64306840c2277670f87be/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:03.101577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e6cdc-9074-40d3-b153-32aae01a3d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629b338976444aae997126e09a847471, user_id=f8b4cee22ae64306840c2277670f87be, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:03.103711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e6cdc-9074-40d3-b153-32aae01a3d57 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:03.127999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1180/2344] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:33:03 2022] PUT /identity/v3/projects/629b338976444aae997126e09a847471/users/f8b4cee22ae64306840c2277670f87be/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:03.130467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0462581-6d52-404f-b7f6-27d0595851da None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:03.130969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0462581-6d52-404f-b7f6-27d0595851da None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:03.131519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0462581-6d52-404f-b7f6-27d0595851da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:03.173828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e0462581-6d52-404f-b7f6-27d0595851da None None] MFA Rules not processed for user `f8b4cee22ae64306840c2277670f87be`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:03.175214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e0462581-6d52-404f-b7f6-27d0595851da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:03.189355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:03.301286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1165/2345] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:03.318572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e6cdc-9074-40d3-b153-32aae01a3d57 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:03.320672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d68e6cdc-9074-40d3-b153-32aae01a3d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:03.417070 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e6cdc-9074-40d3-b153-32aae01a3d57 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:03.421310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88619909-188e-4df5-b122-9d76eaef3ffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:03.422121 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88619909-188e-4df5-b122-9d76eaef3ffa service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:03.422621 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88619909-188e-4df5-b122-9d76eaef3ffa service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:03.423292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88619909-188e-4df5-b122-9d76eaef3ffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:03.439083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88619909-188e-4df5-b122-9d76eaef3ffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:03.439083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88619909-188e-4df5-b122-9d76eaef3ffa service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:03.450852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1181/2346] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:03.505957 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0462581-6d52-404f-b7f6-27d0595851da None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:03.516858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0462581-6d52-404f-b7f6-27d0595851da None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:03.520814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd0483-2a13-4ef9-bbd8-ab8a7534854a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:03.522442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd0483-2a13-4ef9-bbd8-ab8a7534854a service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:03.522879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd0483-2a13-4ef9-bbd8-ab8a7534854a service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:03.523760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd0483-2a13-4ef9-bbd8-ab8a7534854a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:03.593296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd0483-2a13-4ef9-bbd8-ab8a7534854a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:03.594897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd0483-2a13-4ef9-bbd8-ab8a7534854a service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:03.608988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1166/2347] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:07.244641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88619909-188e-4df5-b122-9d76eaef3ffa service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:07.285795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:07.310339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88619909-188e-4df5-b122-9d76eaef3ffa service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:07.315318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:07.316202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:07.316483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:07.316763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] PATH_INFO: `/v3/users/36c1dee2e9c549cb881ec1a206f90247` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:07.317990 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c1dee2e9c549cb881ec1a206f90247)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:07.319952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:07.378176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c1dee2e9c549cb881ec1a206f90247'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:07.392503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c1dee2e9c549cb881ec1a206f90247'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:07.393645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c1dee2e9c549cb881ec1a206f90247'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:07.403170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c1dee2e9c549cb881ec1a206f90247'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:07.413722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c1dee2e9c549cb881ec1a206f90247'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:07.418167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1182/2348] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:33:07 2022] DELETE /identity/v3/users/36c1dee2e9c549cb881ec1a206f90247 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:07.424629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975aa30-4f06-4c23-a8b1-07c2075380ea None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:07.424629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975aa30-4f06-4c23-a8b1-07c2075380ea None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:07.424629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975aa30-4f06-4c23-a8b1-07c2075380ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:07.442670 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a975aa30-4f06-4c23-a8b1-07c2075380ea None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:07.443994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a975aa30-4f06-4c23-a8b1-07c2075380ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:07.506233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1167/2349] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:07.516658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:07.518236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:07.583290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037257cc-0987-4bf9-80ad-94378b3efb1a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:07.587008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ce5ca-effe-45cf-b8cc-28a966066b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:07.587723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce5ca-effe-45cf-b8cc-28a966066b1c service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:07.588012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce5ca-effe-45cf-b8cc-28a966066b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:07.588290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce5ca-effe-45cf-b8cc-28a966066b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:07.600987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ce5ca-effe-45cf-b8cc-28a966066b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:07.602560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ce5ca-effe-45cf-b8cc-28a966066b1c service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:07.614422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1183/2350] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:07.956246 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975aa30-4f06-4c23-a8b1-07c2075380ea None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:07.957929 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a975aa30-4f06-4c23-a8b1-07c2075380ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:07.975850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975aa30-4f06-4c23-a8b1-07c2075380ea None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:07.980617 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:07.981559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:07.981825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:07.982531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] PATH_INFO: `/v3/projects/d8b7cb433cbc42319b4fa4f172c96678` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:07.983825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b7cb433cbc42319b4fa4f172c96678)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:07.986281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:08.028874 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:08.040367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b7cb433cbc42319b4fa4f172c96678', 'request_id': 'req-14f4dbba-d64f-4463-beb7-c86156ab87f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:08.050209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b7cb433cbc42319b4fa4f172c96678', 'request_id': 'req-14f4dbba-d64f-4463-beb7-c86156ab87f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:08.056248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b7cb433cbc42319b4fa4f172c96678', 'request_id': 'req-14f4dbba-d64f-4463-beb7-c86156ab87f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:08.068994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] The token cache is being invalidate because project d8b7cb433cbc42319b4fa4f172c96678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:33:08.069325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:08.070038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:08.071822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1168/2351] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:33:07 2022] DELETE /identity/v3/projects/d8b7cb433cbc42319b4fa4f172c96678 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:08.076596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ce5ca-effe-45cf-b8cc-28a966066b1c service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:08.087059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ce5ca-effe-45cf-b8cc-28a966066b1c service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:08.141996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:08.148950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac624428-25d1-478d-b2bd-eaaa2a92ebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:08.150270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac624428-25d1-478d-b2bd-eaaa2a92ebf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:08.150914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac624428-25d1-478d-b2bd-eaaa2a92ebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:08.151219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac624428-25d1-478d-b2bd-eaaa2a92ebf1 admin admin] PATH_INFO: `/v3/users/f8b4cee22ae64306840c2277670f87be` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:08.152808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac624428-25d1-478d-b2bd-eaaa2a92ebf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b4cee22ae64306840c2277670f87be)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:08.154898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac624428-25d1-478d-b2bd-eaaa2a92ebf1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:08.209136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ac624428-25d1-478d-b2bd-eaaa2a92ebf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b4cee22ae64306840c2277670f87be'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:08.221998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ac624428-25d1-478d-b2bd-eaaa2a92ebf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b4cee22ae64306840c2277670f87be'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:08.222973 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ac624428-25d1-478d-b2bd-eaaa2a92ebf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b4cee22ae64306840c2277670f87be'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:08.239231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ac624428-25d1-478d-b2bd-eaaa2a92ebf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b4cee22ae64306840c2277670f87be'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:08.252469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ac624428-25d1-478d-b2bd-eaaa2a92ebf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b4cee22ae64306840c2277670f87be'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:08.261958 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1184/2352] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:33:08 2022] DELETE /identity/v3/users/f8b4cee22ae64306840c2277670f87be => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:08.800827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:08.803506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:08.831450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4dbba-d64f-4463-beb7-c86156ab87f3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:08.922259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:08.923426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:08.923712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:08.923987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] PATH_INFO: `/v3/projects/629b338976444aae997126e09a847471` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:08.925273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629b338976444aae997126e09a847471)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:08.927227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:08.981309 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629b338976444aae997126e09a847471', 'request_id': 'req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:08.994610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629b338976444aae997126e09a847471', 'request_id': 'req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:09.001345 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629b338976444aae997126e09a847471', 'request_id': 'req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:09.014140 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] The token cache is being invalidate because project 629b338976444aae997126e09a847471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:33:09.014425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:09.015085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a20a1497-2bb2-44d3-9442-7d2bdd398ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:09.016831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1169/2353] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:33:08 2022] DELETE /identity/v3/projects/629b338976444aae997126e09a847471 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:09.022168 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148378-bad1-4617-b844-4b759478f002 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.022529 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148378-bad1-4617-b844-4b759478f002 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.022831 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148378-bad1-4617-b844-4b759478f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.041558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-33148378-bad1-4617-b844-4b759478f002 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:09.042846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-33148378-bad1-4617-b844-4b759478f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:09.104536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1185/2354] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:09.113297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc6f6-bc67-4474-82f9-a77ccf157ce5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.113582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc6f6-bc67-4474-82f9-a77ccf157ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.113855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc6f6-bc67-4474-82f9-a77ccf157ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.135976 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1c4bc6f6-bc67-4474-82f9-a77ccf157ce5 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:09.137274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1c4bc6f6-bc67-4474-82f9-a77ccf157ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:09.146293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1170/2355] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:09.150476 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33148378-bad1-4617-b844-4b759478f002 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:09.162175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33148378-bad1-4617-b844-4b759478f002 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:09.168948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2526-158b-438e-afba-178e1c993451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:09.169757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2526-158b-438e-afba-178e1c993451 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.170105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2526-158b-438e-afba-178e1c993451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.170445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2526-158b-438e-afba-178e1c993451 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.171282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d2526-158b-438e-afba-178e1c993451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:33:09.171629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d2526-158b-438e-afba-178e1c993451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:09.173349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d2526-158b-438e-afba-178e1c993451 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:09.188585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1186/2356] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:33:09.193044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc6f6-bc67-4474-82f9-a77ccf157ce5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:09.202850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc6f6-bc67-4474-82f9-a77ccf157ce5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:09.207778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0aad8-eed0-4470-9a7c-278553d50f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:09.208706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0aad8-eed0-4470-9a7c-278553d50f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.209177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0aad8-eed0-4470-9a7c-278553d50f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.209454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0aad8-eed0-4470-9a7c-278553d50f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.210157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0aad8-eed0-4470-9a7c-278553d50f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:09.212146 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0aad8-eed0-4470-9a7c-278553d50f7b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:09.240274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1171/2357] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:33:09 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:33:09.244633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2526-158b-438e-afba-178e1c993451 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:09.256424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2526-158b-438e-afba-178e1c993451 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:09.319468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d8e80-b1f3-40e2-9fc2-deaf2b689362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:09.320409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d8e80-b1f3-40e2-9fc2-deaf2b689362 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.320834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d8e80-b1f3-40e2-9fc2-deaf2b689362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.321346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d8e80-b1f3-40e2-9fc2-deaf2b689362 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.322080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d8e80-b1f3-40e2-9fc2-deaf2b689362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:09.323949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d8e80-b1f3-40e2-9fc2-deaf2b689362 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:09.333320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:09.353655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1187/2358] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:33:09 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:33:09.358768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0aad8-eed0-4470-9a7c-278553d50f7b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:09.373588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0aad8-eed0-4470-9a7c-278553d50f7b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:09.378237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8f805-1248-41b6-81c5-c7e9bd0b1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:09.378982 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8f805-1248-41b6-81c5-c7e9bd0b1198 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.379223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8f805-1248-41b6-81c5-c7e9bd0b1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.379465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8f805-1248-41b6-81c5-c7e9bd0b1198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.380206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8f805-1248-41b6-81c5-c7e9bd0b1198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:09.381904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8f805-1248-41b6-81c5-c7e9bd0b1198 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:09.393774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1172/2359] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:09.395276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd52f6-1296-40cf-9145-84a2e5db4f39 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.395601 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd52f6-1296-40cf-9145-84a2e5db4f39 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.395904 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd52f6-1296-40cf-9145-84a2e5db4f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.396973 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8f805-1248-41b6-81c5-c7e9bd0b1198 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:09.406901 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8f805-1248-41b6-81c5-c7e9bd0b1198 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:09.412238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5bc8c-fafe-4f22-8eb6-574de59b0ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:09.413153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5bc8c-fafe-4f22-8eb6-574de59b0ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.413679 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5bc8c-fafe-4f22-8eb6-574de59b0ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.413966 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5bc8c-fafe-4f22-8eb6-574de59b0ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.414693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dcdd52f6-1296-40cf-9145-84a2e5db4f39 None None] MFA Rules not processed for user `0a1c4a7e4fdc4a829b8acf762bf576c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:09.414798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5bc8c-fafe-4f22-8eb6-574de59b0ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:09.416136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dcdd52f6-1296-40cf-9145-84a2e5db4f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:09.416529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5bc8c-fafe-4f22-8eb6-574de59b0ed3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:09.426937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1173/2360] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:09.433650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5bc8c-fafe-4f22-8eb6-574de59b0ed3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:09.440518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:09.444632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5bc8c-fafe-4f22-8eb6-574de59b0ed3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:09.452019 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551262c6-1c3d-4e4e-96f9-e898d5267151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:09.453014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551262c6-1c3d-4e4e-96f9-e898d5267151 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.453313 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551262c6-1c3d-4e4e-96f9-e898d5267151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.453589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551262c6-1c3d-4e4e-96f9-e898d5267151 admin admin] PATH_INFO: `/v3/projects/bb02b4bcf0f84214b9356c134531a2ff/users/252d53232b514d40985eeb78e1a31bed/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.468264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551262c6-1c3d-4e4e-96f9-e898d5267151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb02b4bcf0f84214b9356c134531a2ff, user_id=252d53232b514d40985eeb78e1a31bed, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:09.470966 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551262c6-1c3d-4e4e-96f9-e898d5267151 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:09.471859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1188/2361] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:33:09.486889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1174/2362] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:33:09 2022] PUT /identity/v3/projects/bb02b4bcf0f84214b9356c134531a2ff/users/252d53232b514d40985eeb78e1a31bed/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:09.497515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13bd48-f6a7-4cec-aa67-9e4d2b77cb9b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.497779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13bd48-f6a7-4cec-aa67-9e4d2b77cb9b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.498053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13bd48-f6a7-4cec-aa67-9e4d2b77cb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.524842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6b13bd48-f6a7-4cec-aa67-9e4d2b77cb9b None None] MFA Rules not processed for user `252d53232b514d40985eeb78e1a31bed`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:09.526182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6b13bd48-f6a7-4cec-aa67-9e4d2b77cb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:09.603721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1189/2363] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:09.608701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551262c6-1c3d-4e4e-96f9-e898d5267151 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:09.691459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551262c6-1c3d-4e4e-96f9-e898d5267151 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:09.696032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142e8b4-479a-4a97-9015-ffcb134b60d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:09.696704 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142e8b4-479a-4a97-9015-ffcb134b60d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.697010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142e8b4-479a-4a97-9015-ffcb134b60d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.697287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142e8b4-479a-4a97-9015-ffcb134b60d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.698015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142e8b4-479a-4a97-9015-ffcb134b60d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:09.700233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142e8b4-479a-4a97-9015-ffcb134b60d1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:09.731882 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1175/2364] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:33:09 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:33:09.736204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13bd48-f6a7-4cec-aa67-9e4d2b77cb9b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:09.747296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13bd48-f6a7-4cec-aa67-9e4d2b77cb9b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:09.823050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d24f7-ad8f-40f1-84b3-856440c7374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:09.825120 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d24f7-ad8f-40f1-84b3-856440c7374a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.825635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d24f7-ad8f-40f1-84b3-856440c7374a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.826411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d24f7-ad8f-40f1-84b3-856440c7374a admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.827453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d24f7-ad8f-40f1-84b3-856440c7374a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:09.829822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d24f7-ad8f-40f1-84b3-856440c7374a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:09.852455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1190/2365] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:33:09 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:33:09.856686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142e8b4-479a-4a97-9015-ffcb134b60d1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:09.870127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142e8b4-479a-4a97-9015-ffcb134b60d1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:09.876843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5079ea-8698-4dc7-b034-b633bc3a55f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:09.877696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5079ea-8698-4dc7-b034-b633bc3a55f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.877983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5079ea-8698-4dc7-b034-b633bc3a55f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.878268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5079ea-8698-4dc7-b034-b633bc3a55f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.879056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5079ea-8698-4dc7-b034-b633bc3a55f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:09.880723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5079ea-8698-4dc7-b034-b633bc3a55f3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:09.892107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1176/2366] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:09.896190 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d24f7-ad8f-40f1-84b3-856440c7374a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:09.906303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d24f7-ad8f-40f1-84b3-856440c7374a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:09.910853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb09e2-18ed-4dc9-a6e8-c8d16c39f29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:09.911522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb09e2-18ed-4dc9-a6e8-c8d16c39f29c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.911802 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb09e2-18ed-4dc9-a6e8-c8d16c39f29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.912077 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb09e2-18ed-4dc9-a6e8-c8d16c39f29c admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.912815 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb09e2-18ed-4dc9-a6e8-c8d16c39f29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:09.914446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb09e2-18ed-4dc9-a6e8-c8d16c39f29c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:09.927351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1191/2367] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:09.931342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5079ea-8698-4dc7-b034-b633bc3a55f3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:09.942600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5079ea-8698-4dc7-b034-b633bc3a55f3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:09.948815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f4e76-a57a-4e36-a697-283b16fa9755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:09.949879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f4e76-a57a-4e36-a697-283b16fa9755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:09.950261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f4e76-a57a-4e36-a697-283b16fa9755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:09.950548 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f4e76-a57a-4e36-a697-283b16fa9755 admin admin] PATH_INFO: `/v3/projects/403d44c41ebf45d5ba2688b7d31682b6/users/9ed0e4de03674c0e8103d4e76a12c8e0/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:09.969304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f4e76-a57a-4e36-a697-283b16fa9755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403d44c41ebf45d5ba2688b7d31682b6, user_id=9ed0e4de03674c0e8103d4e76a12c8e0, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:09.981198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f4e76-a57a-4e36-a697-283b16fa9755 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:09.993825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1177/2368] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:33:09 2022] PUT /identity/v3/projects/403d44c41ebf45d5ba2688b7d31682b6/users/9ed0e4de03674c0e8103d4e76a12c8e0/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:10.005130 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850040-2f11-4c0a-9352-5163f744ee5d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:10.005673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850040-2f11-4c0a-9352-5163f744ee5d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:10.006166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850040-2f11-4c0a-9352-5163f744ee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:10.022571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:10.039318 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5b850040-2f11-4c0a-9352-5163f744ee5d None None] MFA Rules not processed for user `9ed0e4de03674c0e8103d4e76a12c8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:10.040645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5b850040-2f11-4c0a-9352-5163f744ee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:10.121883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1192/2369] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:10.126556 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f4e76-a57a-4e36-a697-283b16fa9755 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:10.198101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f4e76-a57a-4e36-a697-283b16fa9755 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:10.202962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634ecff-4635-45f4-90cf-4efd57267d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:10.203628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634ecff-4635-45f4-90cf-4efd57267d7e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:10.203904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634ecff-4635-45f4-90cf-4efd57267d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:10.204177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634ecff-4635-45f4-90cf-4efd57267d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:10.204910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634ecff-4635-45f4-90cf-4efd57267d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:10.206833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634ecff-4635-45f4-90cf-4efd57267d7e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:10.235001 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1178/2370] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:33:10 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:33:10.239633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b850040-2f11-4c0a-9352-5163f744ee5d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:10.251136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b850040-2f11-4c0a-9352-5163f744ee5d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:10.316739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3730e05-80f6-4c51-81a7-04cc19340220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:10.320504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730e05-80f6-4c51-81a7-04cc19340220 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:10.320891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730e05-80f6-4c51-81a7-04cc19340220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:10.321298 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730e05-80f6-4c51-81a7-04cc19340220 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:10.322119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3730e05-80f6-4c51-81a7-04cc19340220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:10.324202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3730e05-80f6-4c51-81a7-04cc19340220 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:10.350983 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1193/2371] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:33:10 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:33:10.352229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634ecff-4635-45f4-90cf-4efd57267d7e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:10.364119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634ecff-4635-45f4-90cf-4efd57267d7e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:10.370732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f25f0-13c0-4f54-9d13-c0511b6762d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:10.371542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f25f0-13c0-4f54-9d13-c0511b6762d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:10.371896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f25f0-13c0-4f54-9d13-c0511b6762d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:10.372262 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f25f0-13c0-4f54-9d13-c0511b6762d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:10.373111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f25f0-13c0-4f54-9d13-c0511b6762d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:10.374834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f25f0-13c0-4f54-9d13-c0511b6762d6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:10.389756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1179/2372] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:10.390957 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3730e05-80f6-4c51-81a7-04cc19340220 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:10.403664 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3730e05-80f6-4c51-81a7-04cc19340220 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:10.408618 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3958037-fdeb-431e-b576-7deb5b340125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:10.409641 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3958037-fdeb-431e-b576-7deb5b340125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:10.409927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3958037-fdeb-431e-b576-7deb5b340125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:10.410310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3958037-fdeb-431e-b576-7deb5b340125 admin admin] PATH_INFO: `/v3/projects/2cb66b0129bc4d58bb7ea9a3493ccdb1/users/0a44bed09073487c855f06ecbead3826/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:10.426096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3958037-fdeb-431e-b576-7deb5b340125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb66b0129bc4d58bb7ea9a3493ccdb1, user_id=0a44bed09073487c855f06ecbead3826, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:10.428825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3958037-fdeb-431e-b576-7deb5b340125 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:10.443260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1194/2373] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:33:10 2022] PUT /identity/v3/projects/2cb66b0129bc4d58bb7ea9a3493ccdb1/users/0a44bed09073487c855f06ecbead3826/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:10.447274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f25f0-13c0-4f54-9d13-c0511b6762d6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:10.454982 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:10.459250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f25f0-13c0-4f54-9d13-c0511b6762d6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:10.525991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e835247-abed-4d61-801e-b123d4fa845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:10.526910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e835247-abed-4d61-801e-b123d4fa845b admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:10.527262 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e835247-abed-4d61-801e-b123d4fa845b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:10.527877 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e835247-abed-4d61-801e-b123d4fa845b admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:10.529045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e835247-abed-4d61-801e-b123d4fa845b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:10.530528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e835247-abed-4d61-801e-b123d4fa845b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:10.542502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1180/2374] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:10.546721 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3958037-fdeb-431e-b576-7deb5b340125 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:10.557207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3958037-fdeb-431e-b576-7deb5b340125 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:10.562488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bb449-ffc3-422f-95a6-e7bdfa29c7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:10.563577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb449-ffc3-422f-95a6-e7bdfa29c7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:10.564044 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb449-ffc3-422f-95a6-e7bdfa29c7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:10.564399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb449-ffc3-422f-95a6-e7bdfa29c7c1 admin admin] PATH_INFO: `/v3/projects/2cb66b0129bc4d58bb7ea9a3493ccdb1/users/0a44bed09073487c855f06ecbead3826/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:10.566519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bb449-ffc3-422f-95a6-e7bdfa29c7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb66b0129bc4d58bb7ea9a3493ccdb1, user_id=0a44bed09073487c855f06ecbead3826, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:10.569370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bb449-ffc3-422f-95a6-e7bdfa29c7c1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:10.582466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1195/2375] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:33:10 2022] PUT /identity/v3/projects/2cb66b0129bc4d58bb7ea9a3493ccdb1/users/0a44bed09073487c855f06ecbead3826/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:33:10.592747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da775ed-dc0d-4c4e-89b2-93d6fa629da0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:10.593162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da775ed-dc0d-4c4e-89b2-93d6fa629da0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:10.593365 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da775ed-dc0d-4c4e-89b2-93d6fa629da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:10.621301 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0da775ed-dc0d-4c4e-89b2-93d6fa629da0 None None] MFA Rules not processed for user `0a44bed09073487c855f06ecbead3826`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:10.622759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0da775ed-dc0d-4c4e-89b2-93d6fa629da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:10.695254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1181/2376] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:10.707222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bb449-ffc3-422f-95a6-e7bdfa29c7c1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:10.709241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eb2bb449-ffc3-422f-95a6-e7bdfa29c7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:10.780944 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:10.784894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bb449-ffc3-422f-95a6-e7bdfa29c7c1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:10.789211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97445ef3-4e83-4b00-bea7-e29e53d941ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:10.790082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97445ef3-4e83-4b00-bea7-e29e53d941ee service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:10.790520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97445ef3-4e83-4b00-bea7-e29e53d941ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:10.790806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97445ef3-4e83-4b00-bea7-e29e53d941ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:10.802760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97445ef3-4e83-4b00-bea7-e29e53d941ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:10.804222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97445ef3-4e83-4b00-bea7-e29e53d941ee service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:10.814639 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1196/2377] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:10.866361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da775ed-dc0d-4c4e-89b2-93d6fa629da0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:10.867817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0da775ed-dc0d-4c4e-89b2-93d6fa629da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:10.880822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da775ed-dc0d-4c4e-89b2-93d6fa629da0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:10.884530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14835aad-b6bd-413f-915e-78cb031a2820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:10.885222 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14835aad-b6bd-413f-915e-78cb031a2820 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:10.885506 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14835aad-b6bd-413f-915e-78cb031a2820 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:10.885777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14835aad-b6bd-413f-915e-78cb031a2820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:10.949714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14835aad-b6bd-413f-915e-78cb031a2820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:10.951201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14835aad-b6bd-413f-915e-78cb031a2820 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:10.962095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1182/2378] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:13.920624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97445ef3-4e83-4b00-bea7-e29e53d941ee service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:14.004669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97445ef3-4e83-4b00-bea7-e29e53d941ee service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:14.009800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:14.010862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:14.011167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:14.011447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] PATH_INFO: `/v3/users/252d53232b514d40985eeb78e1a31bed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:14.013457 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252d53232b514d40985eeb78e1a31bed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:14.015087 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:14.076839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252d53232b514d40985eeb78e1a31bed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:14.089862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252d53232b514d40985eeb78e1a31bed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:14.090660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252d53232b514d40985eeb78e1a31bed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:14.098528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252d53232b514d40985eeb78e1a31bed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:14.105859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252d53232b514d40985eeb78e1a31bed'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:14.112700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1197/2379] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:33:13 2022] DELETE /identity/v3/users/252d53232b514d40985eeb78e1a31bed => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:14.117490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77345636-2f41-4055-a9af-6f41034a121d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:14.118002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77345636-2f41-4055-a9af-6f41034a121d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:14.118219 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77345636-2f41-4055-a9af-6f41034a121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:14.135674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-77345636-2f41-4055-a9af-6f41034a121d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:14.136980 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-77345636-2f41-4055-a9af-6f41034a121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:14.155626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:14.199510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1183/2380] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:14.209424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:14.210855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:14.268127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7c918-9294-4b0b-acff-99ddbb9d2164 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:14.271851 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54097-e2f9-4029-b61c-302168133430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:14.272495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54097-e2f9-4029-b61c-302168133430 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:14.272774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54097-e2f9-4029-b61c-302168133430 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:14.273069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54097-e2f9-4029-b61c-302168133430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:14.282058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f54097-e2f9-4029-b61c-302168133430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:14.283494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f54097-e2f9-4029-b61c-302168133430 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:14.292847 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1198/2381] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:15.092127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77345636-2f41-4055-a9af-6f41034a121d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:15.093577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-77345636-2f41-4055-a9af-6f41034a121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:15.199518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77345636-2f41-4055-a9af-6f41034a121d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:15.204195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:15.205166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:15.205537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:15.205811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] PATH_INFO: `/v3/projects/bb02b4bcf0f84214b9356c134531a2ff` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:15.207299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb02b4bcf0f84214b9356c134531a2ff)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:15.209252 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:15.287829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb02b4bcf0f84214b9356c134531a2ff', 'request_id': 'req-798b91b7-f375-4f23-a5da-5864d117eb1e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.297215 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb02b4bcf0f84214b9356c134531a2ff', 'request_id': 'req-798b91b7-f375-4f23-a5da-5864d117eb1e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.303151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb02b4bcf0f84214b9356c134531a2ff', 'request_id': 'req-798b91b7-f375-4f23-a5da-5864d117eb1e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.317748 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] The token cache is being invalidate because project bb02b4bcf0f84214b9356c134531a2ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:33:15.318170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.318829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.320677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1184/2382] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:33:15 2022] DELETE /identity/v3/projects/bb02b4bcf0f84214b9356c134531a2ff => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:15.324483 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54097-e2f9-4029-b61c-302168133430 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:15.341808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:15.374203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54097-e2f9-4029-b61c-302168133430 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:15.431614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:15.432528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:15.432807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:15.433134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] PATH_INFO: `/v3/users/9ed0e4de03674c0e8103d4e76a12c8e0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:15.434623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed0e4de03674c0e8103d4e76a12c8e0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:15.436527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:15.483909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed0e4de03674c0e8103d4e76a12c8e0'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.497045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed0e4de03674c0e8103d4e76a12c8e0'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.497736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed0e4de03674c0e8103d4e76a12c8e0'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.506240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed0e4de03674c0e8103d4e76a12c8e0'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.514227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed0e4de03674c0e8103d4e76a12c8e0'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.520260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1199/2383] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:33:15 2022] DELETE /identity/v3/users/9ed0e4de03674c0e8103d4e76a12c8e0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:15.827194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:15.827194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:15.842243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b91b7-f375-4f23-a5da-5864d117eb1e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:15.889820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:15.903907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:15.904791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:15.905103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:15.905390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] PATH_INFO: `/v3/projects/403d44c41ebf45d5ba2688b7d31682b6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:15.906588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=403d44c41ebf45d5ba2688b7d31682b6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:15.908556 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:15.961818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403d44c41ebf45d5ba2688b7d31682b6', 'request_id': 'req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.970877 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403d44c41ebf45d5ba2688b7d31682b6', 'request_id': 'req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.979141 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403d44c41ebf45d5ba2688b7d31682b6', 'request_id': 'req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.991804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] The token cache is being invalidate because project 403d44c41ebf45d5ba2688b7d31682b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:33:15.992182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.992921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:15.996056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1185/2384] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:33:15 2022] DELETE /identity/v3/projects/403d44c41ebf45d5ba2688b7d31682b6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:16.000005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:16.001466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:16.014744 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c442f6-547f-473e-b59d-7e5488cd61ee admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:16.087342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211ff68-851c-4fd0-96a6-6f6ab69fd2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:16.088558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ff68-851c-4fd0-96a6-6f6ab69fd2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:16.088924 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ff68-851c-4fd0-96a6-6f6ab69fd2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:16.089320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ff68-851c-4fd0-96a6-6f6ab69fd2b7 admin admin] PATH_INFO: `/v3/users/0a44bed09073487c855f06ecbead3826` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:16.090798 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211ff68-851c-4fd0-96a6-6f6ab69fd2b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a44bed09073487c855f06ecbead3826)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:16.093206 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211ff68-851c-4fd0-96a6-6f6ab69fd2b7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:16.095365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:16.184140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e211ff68-851c-4fd0-96a6-6f6ab69fd2b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a44bed09073487c855f06ecbead3826'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:16.197582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e211ff68-851c-4fd0-96a6-6f6ab69fd2b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a44bed09073487c855f06ecbead3826'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:16.198414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e211ff68-851c-4fd0-96a6-6f6ab69fd2b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a44bed09073487c855f06ecbead3826'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:16.217899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e211ff68-851c-4fd0-96a6-6f6ab69fd2b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a44bed09073487c855f06ecbead3826'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:16.228244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e211ff68-851c-4fd0-96a6-6f6ab69fd2b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a44bed09073487c855f06ecbead3826'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:16.239881 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1200/2385] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:33:15 2022] DELETE /identity/v3/users/0a44bed09073487c855f06ecbead3826 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:16.630047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:16.630728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:16.650335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b03fc4-ba43-480c-bc9a-ed38a3aa18b2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:16.748465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:16.749397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:16.749678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:16.749968 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] PATH_INFO: `/v3/projects/2cb66b0129bc4d58bb7ea9a3493ccdb1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:16.751166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb66b0129bc4d58bb7ea9a3493ccdb1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:16.753171 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:16.846914 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb66b0129bc4d58bb7ea9a3493ccdb1', 'request_id': 'req-7f3e067c-fd11-433a-8261-f44dbc7a4a40'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:16.862713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb66b0129bc4d58bb7ea9a3493ccdb1', 'request_id': 'req-7f3e067c-fd11-433a-8261-f44dbc7a4a40'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:16.872929 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb66b0129bc4d58bb7ea9a3493ccdb1', 'request_id': 'req-7f3e067c-fd11-433a-8261-f44dbc7a4a40'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:16.898713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] The token cache is being invalidate because project 2cb66b0129bc4d58bb7ea9a3493ccdb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:33:16.899640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:16.902672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f3e067c-fd11-433a-8261-f44dbc7a4a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:16.909629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1186/2386] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:33:16 2022] DELETE /identity/v3/projects/2cb66b0129bc4d58bb7ea9a3493ccdb1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:16.911747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db796-2415-45d1-b5eb-7f4ab790b7be None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:16.912220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db796-2415-45d1-b5eb-7f4ab790b7be None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:16.912649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db796-2415-45d1-b5eb-7f4ab790b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:16.976073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-074db796-2415-45d1-b5eb-7f4ab790b7be None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:16.977355 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-074db796-2415-45d1-b5eb-7f4ab790b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:17.052183 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1201/2387] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:17.061397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881645-98a5-4f07-805d-391dcd3689e7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:17.061683 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881645-98a5-4f07-805d-391dcd3689e7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:17.061959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881645-98a5-4f07-805d-391dcd3689e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:17.075775 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:17.081617 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c9881645-98a5-4f07-805d-391dcd3689e7 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:17.083756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c9881645-98a5-4f07-805d-391dcd3689e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:17.092629 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1187/2388] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:17.098030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074db796-2415-45d1-b5eb-7f4ab790b7be None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:17.111328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074db796-2415-45d1-b5eb-7f4ab790b7be None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:17.118994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99f88e-24c9-4f47-bb47-07839540502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:17.120138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f88e-24c9-4f47-bb47-07839540502e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:17.120610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f88e-24c9-4f47-bb47-07839540502e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:17.121195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f88e-24c9-4f47-bb47-07839540502e admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:17.122445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99f88e-24c9-4f47-bb47-07839540502e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:33:17.122804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99f88e-24c9-4f47-bb47-07839540502e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:17.125449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99f88e-24c9-4f47-bb47-07839540502e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:17.143920 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1202/2389] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:33:17.145105 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9881645-98a5-4f07-805d-391dcd3689e7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:17.154611 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9881645-98a5-4f07-805d-391dcd3689e7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:17.159979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0eeb7-b70e-4a9d-bf5f-c16c3a9d3bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:17.160662 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0eeb7-b70e-4a9d-bf5f-c16c3a9d3bed admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:17.160926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0eeb7-b70e-4a9d-bf5f-c16c3a9d3bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:17.161227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0eeb7-b70e-4a9d-bf5f-c16c3a9d3bed admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:17.162034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0eeb7-b70e-4a9d-bf5f-c16c3a9d3bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:17.164038 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0eeb7-b70e-4a9d-bf5f-c16c3a9d3bed admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:17.194907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1188/2390] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:33:17 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:33:17.199535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99f88e-24c9-4f47-bb47-07839540502e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:17.209759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99f88e-24c9-4f47-bb47-07839540502e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:17.252893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:17.271336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3e788-b0f7-45c1-886a-c6b1b521c465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:17.272013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3e788-b0f7-45c1-886a-c6b1b521c465 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:17.272287 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3e788-b0f7-45c1-886a-c6b1b521c465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:17.272557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3e788-b0f7-45c1-886a-c6b1b521c465 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:17.273286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3e788-b0f7-45c1-886a-c6b1b521c465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:17.275204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3e788-b0f7-45c1-886a-c6b1b521c465 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:17.295083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1203/2391] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:33:17 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:33:17.299348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0eeb7-b70e-4a9d-bf5f-c16c3a9d3bed admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:17.310039 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0eeb7-b70e-4a9d-bf5f-c16c3a9d3bed admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:17.314978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95bc4d-5aba-46b4-9600-6efa5ce50c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:17.315652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95bc4d-5aba-46b4-9600-6efa5ce50c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:17.315933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95bc4d-5aba-46b4-9600-6efa5ce50c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:17.316206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95bc4d-5aba-46b4-9600-6efa5ce50c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:17.316948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95bc4d-5aba-46b4-9600-6efa5ce50c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:17.318598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95bc4d-5aba-46b4-9600-6efa5ce50c7d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:17.331057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1189/2392] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:17.334820 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3e788-b0f7-45c1-886a-c6b1b521c465 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:17.346506 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3e788-b0f7-45c1-886a-c6b1b521c465 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:17.351948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf7df6-4416-44ab-9410-097450a0442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:17.352618 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf7df6-4416-44ab-9410-097450a0442f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:17.352893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf7df6-4416-44ab-9410-097450a0442f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:17.353194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf7df6-4416-44ab-9410-097450a0442f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:17.353930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf7df6-4416-44ab-9410-097450a0442f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:17.355650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf7df6-4416-44ab-9410-097450a0442f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:17.366615 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1204/2393] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:17.371213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95bc4d-5aba-46b4-9600-6efa5ce50c7d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:17.381739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95bc4d-5aba-46b4-9600-6efa5ce50c7d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:17.387375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb86c0a-c397-43dd-99f4-1bc3d524bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:17.388478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb86c0a-c397-43dd-99f4-1bc3d524bdd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:17.388478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb86c0a-c397-43dd-99f4-1bc3d524bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:17.388905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb86c0a-c397-43dd-99f4-1bc3d524bdd4 admin admin] PATH_INFO: `/v3/projects/01c03e63564646359a0dd54ce7f48e7b/users/f3cfea0e655a4161ae4de69ae1197d5a/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:17.404276 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb86c0a-c397-43dd-99f4-1bc3d524bdd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c03e63564646359a0dd54ce7f48e7b, user_id=f3cfea0e655a4161ae4de69ae1197d5a, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:17.406979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb86c0a-c397-43dd-99f4-1bc3d524bdd4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:17.422353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1190/2394] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:33:17 2022] PUT /identity/v3/projects/01c03e63564646359a0dd54ce7f48e7b/users/f3cfea0e655a4161ae4de69ae1197d5a/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:17.434632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da01bb0-8921-4acf-803c-488e1cc9f39e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:17.434916 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da01bb0-8921-4acf-803c-488e1cc9f39e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:17.435189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da01bb0-8921-4acf-803c-488e1cc9f39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:17.461400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7da01bb0-8921-4acf-803c-488e1cc9f39e None None] MFA Rules not processed for user `f3cfea0e655a4161ae4de69ae1197d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:17.462628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7da01bb0-8921-4acf-803c-488e1cc9f39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:17.529833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1205/2395] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:17.547698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb86c0a-c397-43dd-99f4-1bc3d524bdd4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:17.549868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cfb86c0a-c397-43dd-99f4-1bc3d524bdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:17.634234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb86c0a-c397-43dd-99f4-1bc3d524bdd4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:17.638814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12fb8e-fc92-4534-97af-1e02c6f92862 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f53619b6994ae0a117549a67fa29a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:17.639542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12fb8e-fc92-4534-97af-1e02c6f92862 service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:17.639787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12fb8e-fc92-4534-97af-1e02c6f92862 service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:17.640055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12fb8e-fc92-4534-97af-1e02c6f92862 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:17.651193 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12fb8e-fc92-4534-97af-1e02c6f92862 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:17.653300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12fb8e-fc92-4534-97af-1e02c6f92862 service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:17.663858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1191/2396] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:21.391231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da01bb0-8921-4acf-803c-488e1cc9f39e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:21.393077 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7da01bb0-8921-4acf-803c-488e1cc9f39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:21.504533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da01bb0-8921-4acf-803c-488e1cc9f39e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:21.508211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ce89f-e3fd-4efe-af4a-18e4b3278567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:21.508925 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ce89f-e3fd-4efe-af4a-18e4b3278567 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:21.509299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ce89f-e3fd-4efe-af4a-18e4b3278567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:21.509637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ce89f-e3fd-4efe-af4a-18e4b3278567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:21.511419 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ee4ce89f-e3fd-4efe-af4a-18e4b3278567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:21.560855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:21.580180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ce89f-e3fd-4efe-af4a-18e4b3278567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:21.581662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ce89f-e3fd-4efe-af4a-18e4b3278567 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:21.591569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1206/2397] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:26.283531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b2b33-b245-43b5-acef-c4b286cf25ac None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:26.284601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b2b33-b245-43b5-acef-c4b286cf25ac None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:26.284911 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b2b33-b245-43b5-acef-c4b286cf25ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:26.307720 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-350b2b33-b245-43b5-acef-c4b286cf25ac None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:26.309794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-350b2b33-b245-43b5-acef-c4b286cf25ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:26.376401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1192/2398] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:33:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:26.424533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ce89f-e3fd-4efe-af4a-18e4b3278567 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:26.426143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ee4ce89f-e3fd-4efe-af4a-18e4b3278567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:26.500629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ce89f-e3fd-4efe-af4a-18e4b3278567 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:26.505855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ef4c1-457a-4dd5-9960-59bc0f5f77c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:26.506516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ef4c1-457a-4dd5-9960-59bc0f5f77c8 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:26.506795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ef4c1-457a-4dd5-9960-59bc0f5f77c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:26.507069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ef4c1-457a-4dd5-9960-59bc0f5f77c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:26.515440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ef4c1-457a-4dd5-9960-59bc0f5f77c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:26.517086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ef4c1-457a-4dd5-9960-59bc0f5f77c8 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:26.532768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1207/2399] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:33:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:33:36.369200 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=82,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:36.522188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=40 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:36.843381 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b2b33-b245-43b5-acef-c4b286cf25ac None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:36.845115 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-350b2b33-b245-43b5-acef-c4b286cf25ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:36.860387 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b2b33-b245-43b5-acef-c4b286cf25ac None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:36.864540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1eebb-a71c-4858-9a71-dea15e3f6d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:36.865211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1eebb-a71c-4858-9a71-dea15e3f6d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:36.865508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1eebb-a71c-4858-9a71-dea15e3f6d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:36.865770 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1eebb-a71c-4858-9a71-dea15e3f6d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:36.867714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1ab1eebb-a71c-4858-9a71-dea15e3f6d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:36.931577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1eebb-a71c-4858-9a71-dea15e3f6d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:36.933047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1eebb-a71c-4858-9a71-dea15e3f6d6c service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:36.942826 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1193/2400] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:41.851261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca757d-e1dc-4c01-8441-2e453dd241b9 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:41.851810 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca757d-e1dc-4c01-8441-2e453dd241b9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:41.852078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca757d-e1dc-4c01-8441-2e453dd241b9 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:41.853698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1208/2401] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:41.860077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fa8f0-e9c5-4d2e-aaad-33ef250e647a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:41.860553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fa8f0-e9c5-4d2e-aaad-33ef250e647a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:41.860651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fa8f0-e9c5-4d2e-aaad-33ef250e647a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:41.929755 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-862fa8f0-e9c5-4d2e-aaad-33ef250e647a None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:41.930969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-862fa8f0-e9c5-4d2e-aaad-33ef250e647a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:42.025114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1194/2402] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:33:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:33:42.040494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca757d-e1dc-4c01-8441-2e453dd241b9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:42.042670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e5ca757d-e1dc-4c01-8441-2e453dd241b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:42.060430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca757d-e1dc-4c01-8441-2e453dd241b9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:42.065108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63fcdd-6826-4eaf-9368-f40143533479 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f53619b6994ae0a117549a67fa29a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:42.065767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63fcdd-6826-4eaf-9368-f40143533479 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:42.066040 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63fcdd-6826-4eaf-9368-f40143533479 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:42.066309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63fcdd-6826-4eaf-9368-f40143533479 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:42.076786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63fcdd-6826-4eaf-9368-f40143533479 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:42.078242 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63fcdd-6826-4eaf-9368-f40143533479 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:42.088668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1209/2403] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:33:42.166099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28dbd-596c-4916-a4c6-fbc158bf44ea None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:42.166427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28dbd-596c-4916-a4c6-fbc158bf44ea None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:42.166847 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28dbd-596c-4916-a4c6-fbc158bf44ea None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:42.168984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1195/2404] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:33:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:42.176563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bba7f-df5e-4092-b54c-080847a99775 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:42.176853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bba7f-df5e-4092-b54c-080847a99775 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:42.177171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bba7f-df5e-4092-b54c-080847a99775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:42.196662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0b9bba7f-df5e-4092-b54c-080847a99775 None None] MFA Rules not processed for user `1c5ad3094ee04495a6ab82c92d458aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:42.197902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0b9bba7f-df5e-4092-b54c-080847a99775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:42.205766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1210/2405] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:33:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:42.217719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec28dbd-596c-4916-a4c6-fbc158bf44ea None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:42.229612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec28dbd-596c-4916-a4c6-fbc158bf44ea None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:42.233797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680c243-dcfe-42c2-b0e1-870d9fba8737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:42.234823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680c243-dcfe-42c2-b0e1-870d9fba8737 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:42.235097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680c243-dcfe-42c2-b0e1-870d9fba8737 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:42.235332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680c243-dcfe-42c2-b0e1-870d9fba8737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:42.242478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680c243-dcfe-42c2-b0e1-870d9fba8737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:42.243907 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680c243-dcfe-42c2-b0e1-870d9fba8737 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:42.251878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1196/2406] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:42.340013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082082b0-2030-4701-8a83-6b70c07e3f79 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:42.340302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082082b0-2030-4701-8a83-6b70c07e3f79 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:42.340572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082082b0-2030-4701-8a83-6b70c07e3f79 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:42.341943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1211/2407] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:42.347240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cac465-c948-4ef9-9db2-bef3f63c0999 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:42.347545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cac465-c948-4ef9-9db2-bef3f63c0999 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:42.347842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cac465-c948-4ef9-9db2-bef3f63c0999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:42.367366 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b1cac465-c948-4ef9-9db2-bef3f63c0999 None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:42.368515 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b1cac465-c948-4ef9-9db2-bef3f63c0999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:42.379273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1197/2408] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:33:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:42.389933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082082b0-2030-4701-8a83-6b70c07e3f79 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:42.402394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082082b0-2030-4701-8a83-6b70c07e3f79 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:42.406697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcff36-c327-48ec-b209-6fffe857bc48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:42.407331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcff36-c327-48ec-b209-6fffe857bc48 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:42.407615 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcff36-c327-48ec-b209-6fffe857bc48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:42.407884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcff36-c327-48ec-b209-6fffe857bc48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:42.419159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcff36-c327-48ec-b209-6fffe857bc48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:42.420586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcff36-c327-48ec-b209-6fffe857bc48 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:42.431833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1212/2409] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:46.300688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b404a74-882a-4c0b-acc0-005605ca4aee None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:46.301208 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b404a74-882a-4c0b-acc0-005605ca4aee None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:46.301299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b404a74-882a-4c0b-acc0-005605ca4aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:46.319053 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3b404a74-882a-4c0b-acc0-005605ca4aee None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:46.320234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3b404a74-882a-4c0b-acc0-005605ca4aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:46.328633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1198/2410] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:33:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:46.340653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcff36-c327-48ec-b209-6fffe857bc48 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:46.352086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcff36-c327-48ec-b209-6fffe857bc48 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:46.357349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788fa13-d0ee-414c-8781-cf2ac685b733 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:46.357989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788fa13-d0ee-414c-8781-cf2ac685b733 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:46.358268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788fa13-d0ee-414c-8781-cf2ac685b733 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:46.358541 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788fa13-d0ee-414c-8781-cf2ac685b733 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:46.368001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788fa13-d0ee-414c-8781-cf2ac685b733 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:46.369618 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788fa13-d0ee-414c-8781-cf2ac685b733 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:46.379572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1213/2411] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:33:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 20:33:50.230525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b404a74-882a-4c0b-acc0-005605ca4aee None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:50.236585 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:50.312169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b404a74-882a-4c0b-acc0-005605ca4aee None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:50.317044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:50.318044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:50.318399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:50.318739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] PATH_INFO: `/v3/users/f3cfea0e655a4161ae4de69ae1197d5a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:50.320839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3cfea0e655a4161ae4de69ae1197d5a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:50.322965 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:50.393108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3cfea0e655a4161ae4de69ae1197d5a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:50.406795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3cfea0e655a4161ae4de69ae1197d5a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:50.407750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3cfea0e655a4161ae4de69ae1197d5a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:50.408439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3cfea0e655a4161ae4de69ae1197d5a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:50.425537 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3cfea0e655a4161ae4de69ae1197d5a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:50.448820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1199/2412] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:33:50 2022] DELETE /identity/v3/users/f3cfea0e655a4161ae4de69ae1197d5a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:50.453369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f6890-0375-4db9-8186-95d179325023 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:50.453906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f6890-0375-4db9-8186-95d179325023 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:50.453906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f6890-0375-4db9-8186-95d179325023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:50.473072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4e9f6890-0375-4db9-8186-95d179325023 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:50.474303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4e9f6890-0375-4db9-8186-95d179325023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:50.542353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1214/2413] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:50.553893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:50.555616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:50.619297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074da09-ab1b-46ea-958e-6a178c7c9dab admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:50.623325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9220419-0076-48ce-8196-0ec29218a25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:50.623990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9220419-0076-48ce-8196-0ec29218a25d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:50.624267 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9220419-0076-48ce-8196-0ec29218a25d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:50.624536 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9220419-0076-48ce-8196-0ec29218a25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:50.634864 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9220419-0076-48ce-8196-0ec29218a25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:50.636558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9220419-0076-48ce-8196-0ec29218a25d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:50.647299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1200/2414] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:50.939956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f6890-0375-4db9-8186-95d179325023 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:50.941500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4e9f6890-0375-4db9-8186-95d179325023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:50.959150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f6890-0375-4db9-8186-95d179325023 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:50.966853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:50.967940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:50.968396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:50.968739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] PATH_INFO: `/v3/projects/01c03e63564646359a0dd54ce7f48e7b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:50.970538 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c03e63564646359a0dd54ce7f48e7b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:50.972557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:51.023926 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c03e63564646359a0dd54ce7f48e7b', 'request_id': 'req-d38308d6-0f27-4789-901e-455b9d0c4214'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:51.034961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c03e63564646359a0dd54ce7f48e7b', 'request_id': 'req-d38308d6-0f27-4789-901e-455b9d0c4214'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:51.044058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c03e63564646359a0dd54ce7f48e7b', 'request_id': 'req-d38308d6-0f27-4789-901e-455b9d0c4214'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:51.057659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] The token cache is being invalidate because project 01c03e63564646359a0dd54ce7f48e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:33:51.057923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:51.058598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d38308d6-0f27-4789-901e-455b9d0c4214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:33:51.060524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1215/2415] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:33:50 2022] DELETE /identity/v3/projects/01c03e63564646359a0dd54ce7f48e7b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:51.065492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd747-c453-490e-9471-a7ff1b4ba038 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.065779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd747-c453-490e-9471-a7ff1b4ba038 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.066058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd747-c453-490e-9471-a7ff1b4ba038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.084434 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-922bd747-c453-490e-9471-a7ff1b4ba038 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:51.085668 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-922bd747-c453-490e-9471-a7ff1b4ba038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:51.109938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:51.152446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1201/2416] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:33:51.160382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27aa9d-2bf7-4754-bd09-287fd757a338 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.160667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27aa9d-2bf7-4754-bd09-287fd757a338 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.160949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27aa9d-2bf7-4754-bd09-287fd757a338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.180085 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fb27aa9d-2bf7-4754-bd09-287fd757a338 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:51.181322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fb27aa9d-2bf7-4754-bd09-287fd757a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:51.207685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1216/2417] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:51.209316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bd747-c453-490e-9471-a7ff1b4ba038 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:51.220357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bd747-c453-490e-9471-a7ff1b4ba038 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:51.225332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaba248-7eed-418c-826f-f30920952e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:51.226016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaba248-7eed-418c-826f-f30920952e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.226248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaba248-7eed-418c-826f-f30920952e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.226522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaba248-7eed-418c-826f-f30920952e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.227274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaba248-7eed-418c-826f-f30920952e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:33:51.227719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaba248-7eed-418c-826f-f30920952e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:51.229416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaba248-7eed-418c-826f-f30920952e6d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:51.243022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1202/2418] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:33:51.247463 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27aa9d-2bf7-4754-bd09-287fd757a338 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:51.257775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27aa9d-2bf7-4754-bd09-287fd757a338 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:51.273282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9bd9f-49a9-432a-82cf-4d8c04625015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:51.274315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9bd9f-49a9-432a-82cf-4d8c04625015 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.274649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9bd9f-49a9-432a-82cf-4d8c04625015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.274888 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9bd9f-49a9-432a-82cf-4d8c04625015 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.275914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9bd9f-49a9-432a-82cf-4d8c04625015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:51.278141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9bd9f-49a9-432a-82cf-4d8c04625015 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:51.306386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1217/2419] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:33:51 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:33:51.310229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaba248-7eed-418c-826f-f30920952e6d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:51.320719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaba248-7eed-418c-826f-f30920952e6d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:51.388838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e931-6497-409b-a4eb-3e1789d14261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:51.389728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e931-6497-409b-a4eb-3e1789d14261 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.390100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e931-6497-409b-a4eb-3e1789d14261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.390484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e931-6497-409b-a4eb-3e1789d14261 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.391283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547e931-6497-409b-a4eb-3e1789d14261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:51.393472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547e931-6497-409b-a4eb-3e1789d14261 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:51.414404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1203/2420] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:33:51 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:33:51.418434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9bd9f-49a9-432a-82cf-4d8c04625015 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:51.429673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9bd9f-49a9-432a-82cf-4d8c04625015 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:51.434480 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6a9d-690b-49f1-b845-7d8d56b5a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:51.435279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6a9d-690b-49f1-b845-7d8d56b5a843 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.435653 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6a9d-690b-49f1-b845-7d8d56b5a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.436017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6a9d-690b-49f1-b845-7d8d56b5a843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.436853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6a9d-690b-49f1-b845-7d8d56b5a843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:51.438643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6a9d-690b-49f1-b845-7d8d56b5a843 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:51.441439 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:51.451691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1218/2421] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:33:51.455467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e931-6497-409b-a4eb-3e1789d14261 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:51.467996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e931-6497-409b-a4eb-3e1789d14261 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:51.473502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5879b-a6bf-44fb-a0f4-e6452d888041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:51.474198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5879b-a6bf-44fb-a0f4-e6452d888041 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.474480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5879b-a6bf-44fb-a0f4-e6452d888041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.474756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5879b-a6bf-44fb-a0f4-e6452d888041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.475504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5879b-a6bf-44fb-a0f4-e6452d888041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:51.477207 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5879b-a6bf-44fb-a0f4-e6452d888041 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:51.490351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1204/2422] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:33:51.494608 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6a9d-690b-49f1-b845-7d8d56b5a843 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:51.505735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6a9d-690b-49f1-b845-7d8d56b5a843 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:51.510588 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d53f2-6d62-4cf8-8a94-c92b648123e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:51.511870 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d53f2-6d62-4cf8-8a94-c92b648123e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.512239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d53f2-6d62-4cf8-8a94-c92b648123e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.512600 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d53f2-6d62-4cf8-8a94-c92b648123e8 admin admin] PATH_INFO: `/v3/projects/6a9e8a1f989147e7b46623a4e153bb94/users/842437fd19744f3580538870dcf9424e/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.542792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d53f2-6d62-4cf8-8a94-c92b648123e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9e8a1f989147e7b46623a4e153bb94, user_id=842437fd19744f3580538870dcf9424e, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:51.546086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d53f2-6d62-4cf8-8a94-c92b648123e8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:51.564549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1219/2423] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:33:51 2022] PUT /identity/v3/projects/6a9e8a1f989147e7b46623a4e153bb94/users/842437fd19744f3580538870dcf9424e/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:33:51.570210 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00070e1c-d10a-4309-b64c-5599fb5fc07f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.570510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00070e1c-d10a-4309-b64c-5599fb5fc07f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.570816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00070e1c-d10a-4309-b64c-5599fb5fc07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.593253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-00070e1c-d10a-4309-b64c-5599fb5fc07f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:51.594493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-00070e1c-d10a-4309-b64c-5599fb5fc07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:51.690540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1205/2424] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:51.700548 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d53f2-6d62-4cf8-8a94-c92b648123e8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:51.702598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b41d53f2-6d62-4cf8-8a94-c92b648123e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:51.767071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d53f2-6d62-4cf8-8a94-c92b648123e8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:51.771772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092a27-649e-418f-affb-1d70aafd8c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:51.772446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092a27-649e-418f-affb-1d70aafd8c00 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.772730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092a27-649e-418f-affb-1d70aafd8c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.773040 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092a27-649e-418f-affb-1d70aafd8c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.783211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1092a27-649e-418f-affb-1d70aafd8c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:51.784684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1092a27-649e-418f-affb-1d70aafd8c00 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:51.794737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1220/2425] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:52.565332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413467e-9a32-4b03-a401-d7fc5c9b8e7c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:52.566040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413467e-9a32-4b03-a401-d7fc5c9b8e7c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:52.566040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413467e-9a32-4b03-a401-d7fc5c9b8e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:52.596744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9413467e-9a32-4b03-a401-d7fc5c9b8e7c None None] MFA Rules not processed for user `842437fd19744f3580538870dcf9424e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:52.598365 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9413467e-9a32-4b03-a401-d7fc5c9b8e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:52.645145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:52.727675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1206/2426] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:52.742872 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092a27-649e-418f-affb-1d70aafd8c00 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:52.746011 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f1092a27-649e-418f-affb-1d70aafd8c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:52.881330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092a27-649e-418f-affb-1d70aafd8c00 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:52.885699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60066c0d-5a75-4d80-9137-43fdb856a295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:52.886359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60066c0d-5a75-4d80-9137-43fdb856a295 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:52.886643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60066c0d-5a75-4d80-9137-43fdb856a295 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:52.886928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60066c0d-5a75-4d80-9137-43fdb856a295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:52.896145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60066c0d-5a75-4d80-9137-43fdb856a295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:52.897720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60066c0d-5a75-4d80-9137-43fdb856a295 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:52.909407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1221/2427] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:54.347829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b460c-5124-46fb-96ab-d375acdb3425 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:54.348445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b460c-5124-46fb-96ab-d375acdb3425 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:54.348445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b460c-5124-46fb-96ab-d375acdb3425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:54.368151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-591b460c-5124-46fb-96ab-d375acdb3425 None None] MFA Rules not processed for user `842437fd19744f3580538870dcf9424e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:54.369429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-591b460c-5124-46fb-96ab-d375acdb3425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:54.376658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1207/2428] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:33:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:56.510303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60066c0d-5a75-4d80-9137-43fdb856a295 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:56.511968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-60066c0d-5a75-4d80-9137-43fdb856a295 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:56.582331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:56.613558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60066c0d-5a75-4d80-9137-43fdb856a295 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:56.618998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac1ae4-c936-49d2-81eb-14686c09d8cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df36a267464042908bbd8eebc7c40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:56.619684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1ae4-c936-49d2-81eb-14686c09d8cc service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:56.619944 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1ae4-c936-49d2-81eb-14686c09d8cc service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:56.620211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1ae4-c936-49d2-81eb-14686c09d8cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:56.622111 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-85ac1ae4-c936-49d2-81eb-14686c09d8cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:56.635352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac1ae4-c936-49d2-81eb-14686c09d8cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:56.636874 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac1ae4-c936-49d2-81eb-14686c09d8cc service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:56.646942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1222/2429] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:04.362415 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=21 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:34:06.643244 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=14 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:34:09.057370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614cc8c-3b84-4bd7-922f-dab98dcb4d7e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:09.057942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614cc8c-3b84-4bd7-922f-dab98dcb4d7e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:09.057942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614cc8c-3b84-4bd7-922f-dab98dcb4d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:09.112286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6614cc8c-3b84-4bd7-922f-dab98dcb4d7e None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:09.113465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6614cc8c-3b84-4bd7-922f-dab98dcb4d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:09.181047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1208/2430] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jul 6 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:09.194010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac1ae4-c936-49d2-81eb-14686c09d8cc service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:09.195620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-85ac1ae4-c936-49d2-81eb-14686c09d8cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:09.297673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac1ae4-c936-49d2-81eb-14686c09d8cc service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:09.302765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a9978-4d3c-440e-885f-70b5fb4f6a3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:09.303411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a9978-4d3c-440e-885f-70b5fb4f6a3a service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:09.303690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a9978-4d3c-440e-885f-70b5fb4f6a3a service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:09.303955 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a9978-4d3c-440e-885f-70b5fb4f6a3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:09.312031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a9978-4d3c-440e-885f-70b5fb4f6a3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:09.314506 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a9978-4d3c-440e-885f-70b5fb4f6a3a service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:09.335205 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1223/2431] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:34:19.177331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=40 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:34:19.322179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=41 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:34:54.293718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3283e-f8a6-4a2f-9bda-aaea32a192c1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:54.294314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3283e-f8a6-4a2f-9bda-aaea32a192c1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:54.294314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3283e-f8a6-4a2f-9bda-aaea32a192c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:54.314713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b6f3283e-f8a6-4a2f-9bda-aaea32a192c1 None None] MFA Rules not processed for user `0a1c4a7e4fdc4a829b8acf762bf576c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:54.315931 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b6f3283e-f8a6-4a2f-9bda-aaea32a192c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:54.375620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1209/2432] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:34:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:04.369999 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=25 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:35:07.510513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf293f-073d-4363-b1b1-9e3616b6ff50 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:07.511093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf293f-073d-4363-b1b1-9e3616b6ff50 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:07.511093 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf293f-073d-4363-b1b1-9e3616b6ff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:07.530144 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-05bf293f-073d-4363-b1b1-9e3616b6ff50 None None] MFA Rules not processed for user `842437fd19744f3580538870dcf9424e`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:07.531368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-05bf293f-073d-4363-b1b1-9e3616b6ff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:07.541869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1224/2433] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:35:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:13.526922 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942fa79-db78-408d-bbe1-262c47f69aaf None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:13.527477 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942fa79-db78-408d-bbe1-262c47f69aaf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:13.527477 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942fa79-db78-408d-bbe1-262c47f69aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:13.546331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c942fa79-db78-408d-bbe1-262c47f69aaf None None] MFA Rules not processed for user `3c50cd073cfa45bc9dc52dc65bf7e945`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:13.547523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c942fa79-db78-408d-bbe1-262c47f69aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:13.606055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1210/2434] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:17.524129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:35:23.596451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=25 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:35:42.525908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf293f-073d-4363-b1b1-9e3616b6ff50 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:42.537616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf293f-073d-4363-b1b1-9e3616b6ff50 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:42.542560 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81d3c-f76b-473e-9f7d-78c89b290564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:42.543219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81d3c-f76b-473e-9f7d-78c89b290564 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:42.543501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81d3c-f76b-473e-9f7d-78c89b290564 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:42.543773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81d3c-f76b-473e-9f7d-78c89b290564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:42.545743 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a3f81d3c-f76b-473e-9f7d-78c89b290564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:42.622364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f81d3c-f76b-473e-9f7d-78c89b290564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:42.623793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f81d3c-f76b-473e-9f7d-78c89b290564 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:42.634813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1225/2435] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:47.873552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942fa79-db78-408d-bbe1-262c47f69aaf None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:47.884140 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942fa79-db78-408d-bbe1-262c47f69aaf None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:47.889172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2673e-bb36-4cc5-b3c7-231b481db303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:47.889833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2673e-bb36-4cc5-b3c7-231b481db303 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:47.890107 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2673e-bb36-4cc5-b3c7-231b481db303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:47.890376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2673e-bb36-4cc5-b3c7-231b481db303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:47.892404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-26c2673e-bb36-4cc5-b3c7-231b481db303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:47.908383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2673e-bb36-4cc5-b3c7-231b481db303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:47.909862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2673e-bb36-4cc5-b3c7-231b481db303 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:47.921459 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1211/2436] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:52.629932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=34 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:35:57.915928 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:03.495767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9cc3-630d-4fab-b4d6-8610484e0417 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:03.496270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9cc3-630d-4fab-b4d6-8610484e0417 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:03.496375 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9cc3-630d-4fab-b4d6-8610484e0417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:03.514727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b2ee9cc3-630d-4fab-b4d6-8610484e0417 None None] MFA Rules not processed for user `eca463f83a0d4677b1c10d388ab60419`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:03.515954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b2ee9cc3-630d-4fab-b4d6-8610484e0417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:03.570242 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1226/2437] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:04.543961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2673e-bb36-4cc5-b3c7-231b481db303 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:04.545746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-26c2673e-bb36-4cc5-b3c7-231b481db303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:04.560672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2673e-bb36-4cc5-b3c7-231b481db303 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:04.567076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e4835-1434-4a37-9bef-9b39bdb48c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:04.567803 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e4835-1434-4a37-9bef-9b39bdb48c2f service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:04.568142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e4835-1434-4a37-9bef-9b39bdb48c2f service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:04.568478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e4835-1434-4a37-9bef-9b39bdb48c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:04.570447 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-964e4835-1434-4a37-9bef-9b39bdb48c2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:04.581425 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e4835-1434-4a37-9bef-9b39bdb48c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:04.583016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e4835-1434-4a37-9bef-9b39bdb48c2f service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:04.592175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1212/2438] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:08.174110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9cc3-630d-4fab-b4d6-8610484e0417 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:08.186269 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9cc3-630d-4fab-b4d6-8610484e0417 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:08.190799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995763d9-f02f-49ff-9995-707dc3399252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:08.191751 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995763d9-f02f-49ff-9995-707dc3399252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:08.192117 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995763d9-f02f-49ff-9995-707dc3399252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:08.192396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995763d9-f02f-49ff-9995-707dc3399252 admin admin] PATH_INFO: `/v3/users/842437fd19744f3580538870dcf9424e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:08.193619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995763d9-f02f-49ff-9995-707dc3399252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=842437fd19744f3580538870dcf9424e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:08.195530 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995763d9-f02f-49ff-9995-707dc3399252 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:08.250335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-995763d9-f02f-49ff-9995-707dc3399252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842437fd19744f3580538870dcf9424e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:08.262254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-995763d9-f02f-49ff-9995-707dc3399252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842437fd19744f3580538870dcf9424e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:08.262919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-995763d9-f02f-49ff-9995-707dc3399252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842437fd19744f3580538870dcf9424e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:08.271503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-995763d9-f02f-49ff-9995-707dc3399252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842437fd19744f3580538870dcf9424e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:08.278001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-995763d9-f02f-49ff-9995-707dc3399252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842437fd19744f3580538870dcf9424e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:08.284064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1227/2439] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:36:08 2022] DELETE /identity/v3/users/842437fd19744f3580538870dcf9424e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:08.471673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e4835-1434-4a37-9bef-9b39bdb48c2f service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:08.484614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e4835-1434-4a37-9bef-9b39bdb48c2f service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:08.550989 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:08.551915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:08.552205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:08.552465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] PATH_INFO: `/v3/projects/6a9e8a1f989147e7b46623a4e153bb94` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:08.553781 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9e8a1f989147e7b46623a4e153bb94)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:08.555768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:08.615942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9e8a1f989147e7b46623a4e153bb94', 'request_id': 'req-56018045-1ad8-4fc0-afb1-fce9549487ed'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:08.625735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9e8a1f989147e7b46623a4e153bb94', 'request_id': 'req-56018045-1ad8-4fc0-afb1-fce9549487ed'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:08.633216 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9e8a1f989147e7b46623a4e153bb94', 'request_id': 'req-56018045-1ad8-4fc0-afb1-fce9549487ed'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:08.647877 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] The token cache is being invalidate because project 6a9e8a1f989147e7b46623a4e153bb94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:36:08.648279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:08.649073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:08.651052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1213/2440] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:36:08 2022] DELETE /identity/v3/projects/6a9e8a1f989147e7b46623a4e153bb94 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:08.656365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3d3b-f60f-4536-bf6f-b5fdc31b585c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:08.656737 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3d3b-f60f-4536-bf6f-b5fdc31b585c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:08.657398 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3d3b-f60f-4536-bf6f-b5fdc31b585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:08.676253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8dcd3d3b-f60f-4536-bf6f-b5fdc31b585c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:08.677739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8dcd3d3b-f60f-4536-bf6f-b5fdc31b585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:08.694007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:08.695430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:08.760668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1228/2441] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:08.768761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7482f-61aa-498a-bcc8-b5f99a5fe384 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:08.769300 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7482f-61aa-498a-bcc8-b5f99a5fe384 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:08.769580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7482f-61aa-498a-bcc8-b5f99a5fe384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:08.789916 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-31e7482f-61aa-498a-bcc8-b5f99a5fe384 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:08.791150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-31e7482f-61aa-498a-bcc8-b5f99a5fe384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:08.801124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56018045-1ad8-4fc0-afb1-fce9549487ed admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:08.805246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1229/2442] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:36:08.806253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7482f-61aa-498a-bcc8-b5f99a5fe384 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:08.806754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29074f-4609-4bf2-a7b7-7d1ce27284e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:08.807430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29074f-4609-4bf2-a7b7-7d1ce27284e3 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:08.807706 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29074f-4609-4bf2-a7b7-7d1ce27284e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:08.807977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29074f-4609-4bf2-a7b7-7d1ce27284e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:08.809845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9f29074f-4609-4bf2-a7b7-7d1ce27284e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:08.816147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7482f-61aa-498a-bcc8-b5f99a5fe384 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:08.821166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9242fa-65fc-46e7-b036-0dda99cecb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:08.825641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:08.826736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9242fa-65fc-46e7-b036-0dda99cecb30 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:08.826997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9242fa-65fc-46e7-b036-0dda99cecb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:08.827402 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9242fa-65fc-46e7-b036-0dda99cecb30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:08.828683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9242fa-65fc-46e7-b036-0dda99cecb30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:36:08.828683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9242fa-65fc-46e7-b036-0dda99cecb30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:08.831220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9242fa-65fc-46e7-b036-0dda99cecb30 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:08.839656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:08.851274 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1230/2443] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:36:08.852384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9242fa-65fc-46e7-b036-0dda99cecb30 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:08.865489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9242fa-65fc-46e7-b036-0dda99cecb30 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:08.872319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9b50d-e11b-4dba-832e-b0f61d70dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:08.872319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9b50d-e11b-4dba-832e-b0f61d70dccb admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:08.872319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9b50d-e11b-4dba-832e-b0f61d70dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:08.872319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9b50d-e11b-4dba-832e-b0f61d70dccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:08.872733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9b50d-e11b-4dba-832e-b0f61d70dccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:08.874690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9b50d-e11b-4dba-832e-b0f61d70dccb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:08.919202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1231/2444] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:36:08 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:08.928526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9b50d-e11b-4dba-832e-b0f61d70dccb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:08.942610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29074f-4609-4bf2-a7b7-7d1ce27284e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:08.948591 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29074f-4609-4bf2-a7b7-7d1ce27284e3 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:08.983040 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1214/2445] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:09.087188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9b50d-e11b-4dba-832e-b0f61d70dccb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:09.089054 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29074f-4609-4bf2-a7b7-7d1ce27284e3 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:09.090490 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9f29074f-4609-4bf2-a7b7-7d1ce27284e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:09.093832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24b4d0-824b-4d9c-87bb-7d7babfb500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:09.094715 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24b4d0-824b-4d9c-87bb-7d7babfb500e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:09.095152 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24b4d0-824b-4d9c-87bb-7d7babfb500e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:09.095573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24b4d0-824b-4d9c-87bb-7d7babfb500e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:09.096438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24b4d0-824b-4d9c-87bb-7d7babfb500e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:09.100345 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24b4d0-824b-4d9c-87bb-7d7babfb500e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:09.134073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1232/2446] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:36:08 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:09.137863 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24b4d0-824b-4d9c-87bb-7d7babfb500e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:09.152518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24b4d0-824b-4d9c-87bb-7d7babfb500e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:09.159523 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398a570-36a2-4f09-8b82-f629fc821d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:09.160603 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398a570-36a2-4f09-8b82-f629fc821d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:09.161536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398a570-36a2-4f09-8b82-f629fc821d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:09.161932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398a570-36a2-4f09-8b82-f629fc821d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:09.162797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398a570-36a2-4f09-8b82-f629fc821d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:09.164795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398a570-36a2-4f09-8b82-f629fc821d26 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:09.205497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1233/2447] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:09.209723 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398a570-36a2-4f09-8b82-f629fc821d26 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:09.241988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29074f-4609-4bf2-a7b7-7d1ce27284e3 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:09.245939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398a570-36a2-4f09-8b82-f629fc821d26 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:09.265361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888afb9-ab5a-4530-a2ab-4a8e6beab72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:09.266184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888afb9-ab5a-4530-a2ab-4a8e6beab72d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:09.266899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888afb9-ab5a-4530-a2ab-4a8e6beab72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:09.267718 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888afb9-ab5a-4530-a2ab-4a8e6beab72d admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:09.271116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888afb9-ab5a-4530-a2ab-4a8e6beab72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:09.274332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888afb9-ab5a-4530-a2ab-4a8e6beab72d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:09.293928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1234/2448] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:09.298426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888afb9-ab5a-4530-a2ab-4a8e6beab72d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:09.325268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888afb9-ab5a-4530-a2ab-4a8e6beab72d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:09.331369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035acb2-3d03-4692-a318-4bebca9ab9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:09.332683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035acb2-3d03-4692-a318-4bebca9ab9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:09.333316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035acb2-3d03-4692-a318-4bebca9ab9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:09.333694 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035acb2-3d03-4692-a318-4bebca9ab9c3 admin admin] PATH_INFO: `/v3/projects/93a996db48a34eaf9692c0e92414c2b4/users/31306b56242f4761980cec667e783af1/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:09.355765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035acb2-3d03-4692-a318-4bebca9ab9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a996db48a34eaf9692c0e92414c2b4, user_id=31306b56242f4761980cec667e783af1, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:09.359464 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035acb2-3d03-4692-a318-4bebca9ab9c3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:09.379626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1235/2449] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:36:09 2022] PUT /identity/v3/projects/93a996db48a34eaf9692c0e92414c2b4/users/31306b56242f4761980cec667e783af1/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:09.392233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83f47-7bf6-4ac0-8ce9-1cb2067db8af None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:09.392233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83f47-7bf6-4ac0-8ce9-1cb2067db8af None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:09.392233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83f47-7bf6-4ac0-8ce9-1cb2067db8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:09.415847 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042c845-bf6e-448e-a42d-a18918cb9023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:09.416766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c845-bf6e-448e-a42d-a18918cb9023 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:09.417153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c845-bf6e-448e-a42d-a18918cb9023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:09.417473 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c845-bf6e-448e-a42d-a18918cb9023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:09.418629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-66f83f47-7bf6-4ac0-8ce9-1cb2067db8af None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:09.419602 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0042c845-bf6e-448e-a42d-a18918cb9023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:09.420493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-66f83f47-7bf6-4ac0-8ce9-1cb2067db8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:09.478161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042c845-bf6e-448e-a42d-a18918cb9023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:09.480148 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042c845-bf6e-448e-a42d-a18918cb9023 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:09.505568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1215/2450] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:36:09.527589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1236/2451] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:09.537428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042c845-bf6e-448e-a42d-a18918cb9023 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:09.540015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0042c845-bf6e-448e-a42d-a18918cb9023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:09.554957 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042c845-bf6e-448e-a42d-a18918cb9023 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:09.633467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0e9ec-17df-466f-972c-dbc713c5643f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:09.634569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0e9ec-17df-466f-972c-dbc713c5643f service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:09.635017 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0e9ec-17df-466f-972c-dbc713c5643f service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:09.635296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0e9ec-17df-466f-972c-dbc713c5643f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:09.658738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0e9ec-17df-466f-972c-dbc713c5643f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:09.660883 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0e9ec-17df-466f-972c-dbc713c5643f service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:09.676057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1216/2452] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:10.540620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285735a8-44ef-4609-bec8-f1c8b15a31c1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:10.549216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285735a8-44ef-4609-bec8-f1c8b15a31c1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:10.549216 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285735a8-44ef-4609-bec8-f1c8b15a31c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:10.570766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-285735a8-44ef-4609-bec8-f1c8b15a31c1 None None] MFA Rules not processed for user `e23fcb16b89d4fe6a6f03466f8d0d575`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:10.572334 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-285735a8-44ef-4609-bec8-f1c8b15a31c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:10.610491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:10.688095 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1237/2453] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:11.581633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0e9ec-17df-466f-972c-dbc713c5643f service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:11.598631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0e9ec-17df-466f-972c-dbc713c5643f service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:11.612925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9c9cd-3471-49a5-95b6-cc7d8a5a5e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:11.615165 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9c9cd-3471-49a5-95b6-cc7d8a5a5e1d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:11.615510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9c9cd-3471-49a5-95b6-cc7d8a5a5e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:11.615797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9c9cd-3471-49a5-95b6-cc7d8a5a5e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:11.617925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d5b9c9cd-3471-49a5-95b6-cc7d8a5a5e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:11.630129 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9c9cd-3471-49a5-95b6-cc7d8a5a5e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:11.631741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9c9cd-3471-49a5-95b6-cc7d8a5a5e1d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:11.645823 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1217/2454] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:12.529871 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285735a8-44ef-4609-bec8-f1c8b15a31c1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:12.533154 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-285735a8-44ef-4609-bec8-f1c8b15a31c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:12.642573 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285735a8-44ef-4609-bec8-f1c8b15a31c1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:12.649339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004f6ce-e3d2-4221-b4ce-f8e548dac00e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df36a267464042908bbd8eebc7c40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:12.650561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004f6ce-e3d2-4221-b4ce-f8e548dac00e service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:12.651058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004f6ce-e3d2-4221-b4ce-f8e548dac00e service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:12.651540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004f6ce-e3d2-4221-b4ce-f8e548dac00e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:12.653761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a004f6ce-e3d2-4221-b4ce-f8e548dac00e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:12.683702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004f6ce-e3d2-4221-b4ce-f8e548dac00e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:12.683702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004f6ce-e3d2-4221-b4ce-f8e548dac00e service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:12.700305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1238/2455] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:12.761735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9c9cd-3471-49a5-95b6-cc7d8a5a5e1d service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:12.763195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d5b9c9cd-3471-49a5-95b6-cc7d8a5a5e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:12.768778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:12.906382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9c9cd-3471-49a5-95b6-cc7d8a5a5e1d service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:12.914339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed9e9-584e-4655-8725-5e3941340a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:12.915456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed9e9-584e-4655-8725-5e3941340a60 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:12.915796 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed9e9-584e-4655-8725-5e3941340a60 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:12.916218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed9e9-584e-4655-8725-5e3941340a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:12.918422 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-adaed9e9-584e-4655-8725-5e3941340a60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:13.005597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed9e9-584e-4655-8725-5e3941340a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:13.008341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed9e9-584e-4655-8725-5e3941340a60 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:13.036890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1218/2456] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:17.058675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004f6ce-e3d2-4221-b4ce-f8e548dac00e service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:17.060172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a004f6ce-e3d2-4221-b4ce-f8e548dac00e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:17.074053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004f6ce-e3d2-4221-b4ce-f8e548dac00e service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:17.084656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c888a9-5bd1-487a-ae24-ee74f1649e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:17.085787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c888a9-5bd1-487a-ae24-ee74f1649e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:17.086402 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c888a9-5bd1-487a-ae24-ee74f1649e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:17.086826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c888a9-5bd1-487a-ae24-ee74f1649e6a admin admin] PATH_INFO: `/v3/users/0a1c4a7e4fdc4a829b8acf762bf576c1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:17.088688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c888a9-5bd1-487a-ae24-ee74f1649e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1c4a7e4fdc4a829b8acf762bf576c1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:17.091447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c888a9-5bd1-487a-ae24-ee74f1649e6a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:17.149710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-18c888a9-5bd1-487a-ae24-ee74f1649e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1c4a7e4fdc4a829b8acf762bf576c1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:17.167554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-18c888a9-5bd1-487a-ae24-ee74f1649e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1c4a7e4fdc4a829b8acf762bf576c1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:17.168160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-18c888a9-5bd1-487a-ae24-ee74f1649e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1c4a7e4fdc4a829b8acf762bf576c1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:17.178378 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-18c888a9-5bd1-487a-ae24-ee74f1649e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1c4a7e4fdc4a829b8acf762bf576c1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:17.188819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-18c888a9-5bd1-487a-ae24-ee74f1649e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1c4a7e4fdc4a829b8acf762bf576c1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:17.196253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1239/2457] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:36:17 2022] DELETE /identity/v3/users/0a1c4a7e4fdc4a829b8acf762bf576c1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:17.571709 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed9e9-584e-4655-8725-5e3941340a60 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:17.588612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed9e9-584e-4655-8725-5e3941340a60 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:17.694315 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:17.695198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:17.695480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:17.695868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] PATH_INFO: `/v3/projects/815783b3ca0c40a3a8475a811bef38fd` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:17.697133 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=815783b3ca0c40a3a8475a811bef38fd)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:17.699064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:17.766675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:17.774758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815783b3ca0c40a3a8475a811bef38fd', 'request_id': 'req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:17.786163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815783b3ca0c40a3a8475a811bef38fd', 'request_id': 'req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:17.799337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815783b3ca0c40a3a8475a811bef38fd', 'request_id': 'req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:17.838473 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] The token cache is being invalidate because project 815783b3ca0c40a3a8475a811bef38fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:36:17.838805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:17.839607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1c3a7e90-5ee1-4cb5-bed5-a1ef6d732bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:17.842473 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1219/2458] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:36:17 2022] DELETE /identity/v3/projects/815783b3ca0c40a3a8475a811bef38fd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:17.848911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1955b9-6aec-4ca1-8ba7-5eb8141a5e8d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:17.849633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1955b9-6aec-4ca1-8ba7-5eb8141a5e8d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:17.850109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1955b9-6aec-4ca1-8ba7-5eb8141a5e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:17.876883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bc1955b9-6aec-4ca1-8ba7-5eb8141a5e8d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:17.878180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bc1955b9-6aec-4ca1-8ba7-5eb8141a5e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:17.911813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:17.977397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1240/2459] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:17.985396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa9281-1035-4ad3-91c4-0bf9ad11005e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:17.985688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa9281-1035-4ad3-91c4-0bf9ad11005e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:17.985966 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa9281-1035-4ad3-91c4-0bf9ad11005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.006692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c5aa9281-1035-4ad3-91c4-0bf9ad11005e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:18.008083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c5aa9281-1035-4ad3-91c4-0bf9ad11005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:18.017048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1220/2460] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:18.021435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1955b9-6aec-4ca1-8ba7-5eb8141a5e8d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:18.032931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1955b9-6aec-4ca1-8ba7-5eb8141a5e8d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:18.039598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050fe97-a488-496b-bde8-d216030162c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:18.040291 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050fe97-a488-496b-bde8-d216030162c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.040730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050fe97-a488-496b-bde8-d216030162c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.041049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050fe97-a488-496b-bde8-d216030162c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.041911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050fe97-a488-496b-bde8-d216030162c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:36:18.042224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050fe97-a488-496b-bde8-d216030162c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:18.043883 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050fe97-a488-496b-bde8-d216030162c4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:18.058268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1241/2461] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:36:18.062852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa9281-1035-4ad3-91c4-0bf9ad11005e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:18.072587 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa9281-1035-4ad3-91c4-0bf9ad11005e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:18.078159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078aedc-ed6f-4848-9f23-b6505b914809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:18.078853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078aedc-ed6f-4848-9f23-b6505b914809 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.079320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078aedc-ed6f-4848-9f23-b6505b914809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.079834 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078aedc-ed6f-4848-9f23-b6505b914809 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.080577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078aedc-ed6f-4848-9f23-b6505b914809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:18.082646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078aedc-ed6f-4848-9f23-b6505b914809 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:18.125781 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1221/2462] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:36:18 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:18.130050 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050fe97-a488-496b-bde8-d216030162c4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:18.145610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050fe97-a488-496b-bde8-d216030162c4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:18.237474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdac6b-7437-4363-943e-5a571b37c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:18.240394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdac6b-7437-4363-943e-5a571b37c4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.241006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdac6b-7437-4363-943e-5a571b37c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.241931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdac6b-7437-4363-943e-5a571b37c4ac admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.243836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdac6b-7437-4363-943e-5a571b37c4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:18.246888 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdac6b-7437-4363-943e-5a571b37c4ac admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:18.295793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1242/2463] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:36:18 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:18.300347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078aedc-ed6f-4848-9f23-b6505b914809 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:18.311994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078aedc-ed6f-4848-9f23-b6505b914809 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:18.317538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dae0c-129b-429e-ad52-51acc49919e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:18.318242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dae0c-129b-429e-ad52-51acc49919e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.318528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dae0c-129b-429e-ad52-51acc49919e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.318805 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dae0c-129b-429e-ad52-51acc49919e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.320087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dae0c-129b-429e-ad52-51acc49919e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:18.321436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dae0c-129b-429e-ad52-51acc49919e2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:18.338940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1222/2464] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:18.340203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdac6b-7437-4363-943e-5a571b37c4ac admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:18.353162 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdac6b-7437-4363-943e-5a571b37c4ac admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:18.362027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1b2c4-9680-40ca-a068-ed0c4d2b648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:18.363051 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1b2c4-9680-40ca-a068-ed0c4d2b648a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.363436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1b2c4-9680-40ca-a068-ed0c4d2b648a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.363803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1b2c4-9680-40ca-a068-ed0c4d2b648a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.364845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1b2c4-9680-40ca-a068-ed0c4d2b648a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:18.367106 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1b2c4-9680-40ca-a068-ed0c4d2b648a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:18.382892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1243/2465] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:18.383740 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dae0c-129b-429e-ad52-51acc49919e2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:18.399504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dae0c-129b-429e-ad52-51acc49919e2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:18.405133 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed25027-51b3-46bd-895d-6a1d7f2235f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:18.406036 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25027-51b3-46bd-895d-6a1d7f2235f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.406316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25027-51b3-46bd-895d-6a1d7f2235f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.406586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25027-51b3-46bd-895d-6a1d7f2235f0 admin admin] PATH_INFO: `/v3/projects/7b4f96f4950042888814dc45d308a3d4/users/f1b69b6d5a5f42c6a8c0f552a9c569a5/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.423949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed25027-51b3-46bd-895d-6a1d7f2235f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4f96f4950042888814dc45d308a3d4, user_id=f1b69b6d5a5f42c6a8c0f552a9c569a5, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:18.427582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed25027-51b3-46bd-895d-6a1d7f2235f0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:18.444597 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1223/2466] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:36:18 2022] PUT /identity/v3/projects/7b4f96f4950042888814dc45d308a3d4/users/f1b69b6d5a5f42c6a8c0f552a9c569a5/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:18.458558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f659f-40d9-447b-bd0e-4e57eea98b1b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.458774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f659f-40d9-447b-bd0e-4e57eea98b1b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.459088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f659f-40d9-447b-bd0e-4e57eea98b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.499269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2888-12ce-492e-84fb-91d221305951 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.499568 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2888-12ce-492e-84fb-91d221305951 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.499848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2888-12ce-492e-84fb-91d221305951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.508534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-400f659f-40d9-447b-bd0e-4e57eea98b1b None None] MFA Rules not processed for user `f1b69b6d5a5f42c6a8c0f552a9c569a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:18.510257 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-400f659f-40d9-447b-bd0e-4e57eea98b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:18.529223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1dca2888-12ce-492e-84fb-91d221305951 None None] MFA Rules not processed for user `31306b56242f4761980cec667e783af1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:18.531427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1dca2888-12ce-492e-84fb-91d221305951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:18.608997 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1244/2467] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:18.620076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1224/2468] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:18.620688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f659f-40d9-447b-bd0e-4e57eea98b1b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:18.621139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca2888-12ce-492e-84fb-91d221305951 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:18.622132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-400f659f-40d9-447b-bd0e-4e57eea98b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:18.622663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1dca2888-12ce-492e-84fb-91d221305951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:18.655332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:18.699465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:18.710719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca2888-12ce-492e-84fb-91d221305951 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:18.720909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f659f-40d9-447b-bd0e-4e57eea98b1b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:18.724324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af774-5bbf-4621-920b-8f4a0fa45c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:18.726024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af774-5bbf-4621-920b-8f4a0fa45c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.726402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af774-5bbf-4621-920b-8f4a0fa45c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.726684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af774-5bbf-4621-920b-8f4a0fa45c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.727429 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345af774-5bbf-4621-920b-8f4a0fa45c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:18.728884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7695fc-cf75-454f-b4e5-1633161f3cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:18.729632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345af774-5bbf-4621-920b-8f4a0fa45c7f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:18.729979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7695fc-cf75-454f-b4e5-1633161f3cc6 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.730449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7695fc-cf75-454f-b4e5-1633161f3cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.730893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7695fc-cf75-454f-b4e5-1633161f3cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.744660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7695fc-cf75-454f-b4e5-1633161f3cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:18.749962 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7695fc-cf75-454f-b4e5-1633161f3cc6 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:18.767712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1225/2469] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:36:18 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:18.769948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1245/2470] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:18.771458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af774-5bbf-4621-920b-8f4a0fa45c7f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:18.851015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af774-5bbf-4621-920b-8f4a0fa45c7f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:18.856051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4d2c2-686b-4ce6-b89f-c99ed2eb7f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:18.856981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4d2c2-686b-4ce6-b89f-c99ed2eb7f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.857393 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4d2c2-686b-4ce6-b89f-c99ed2eb7f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.857742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4d2c2-686b-4ce6-b89f-c99ed2eb7f73 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.858671 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4d2c2-686b-4ce6-b89f-c99ed2eb7f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:18.860912 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4d2c2-686b-4ce6-b89f-c99ed2eb7f73 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:18.896892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1226/2471] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:36:18 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:36:18.897016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7695fc-cf75-454f-b4e5-1633161f3cc6 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:18.905962 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7695fc-cf75-454f-b4e5-1633161f3cc6 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:18.910823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b9d28-85bc-40b1-93b7-bc35735b927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:18.911510 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b9d28-85bc-40b1-93b7-bc35735b927b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.911792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b9d28-85bc-40b1-93b7-bc35735b927b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.912068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b9d28-85bc-40b1-93b7-bc35735b927b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.912804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b9d28-85bc-40b1-93b7-bc35735b927b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:18.914477 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b9d28-85bc-40b1-93b7-bc35735b927b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:18.936996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1246/2472] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:36:18.940816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4d2c2-686b-4ce6-b89f-c99ed2eb7f73 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:18.953348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4d2c2-686b-4ce6-b89f-c99ed2eb7f73 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:18.961351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603998d-926d-4d03-8acd-83d73a49aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:18.962281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603998d-926d-4d03-8acd-83d73a49aeb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:18.962790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603998d-926d-4d03-8acd-83d73a49aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:18.962913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603998d-926d-4d03-8acd-83d73a49aeb6 admin admin] PATH_INFO: `/v3/projects/1246eb35c5414d1c96a2928aee02f027/users/abc07a8316ad4343ab80a09bd5f3ccb9/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:18.985177 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603998d-926d-4d03-8acd-83d73a49aeb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1246eb35c5414d1c96a2928aee02f027, user_id=abc07a8316ad4343ab80a09bd5f3ccb9, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:18.988261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603998d-926d-4d03-8acd-83d73a49aeb6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:19.013347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1227/2473] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:36:18 2022] PUT /identity/v3/projects/1246eb35c5414d1c96a2928aee02f027/users/abc07a8316ad4343ab80a09bd5f3ccb9/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:19.017923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b9d28-85bc-40b1-93b7-bc35735b927b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:19.037136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b9d28-85bc-40b1-93b7-bc35735b927b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:19.134692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb75e95-8324-486c-88a3-df90a9a1fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:19.135545 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb75e95-8324-486c-88a3-df90a9a1fbeb admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:19.135832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb75e95-8324-486c-88a3-df90a9a1fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:19.136108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb75e95-8324-486c-88a3-df90a9a1fbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:19.137759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb75e95-8324-486c-88a3-df90a9a1fbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:19.139467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb75e95-8324-486c-88a3-df90a9a1fbeb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:19.170421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1247/2474] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:19.171905 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603998d-926d-4d03-8acd-83d73a49aeb6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:19.196864 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603998d-926d-4d03-8acd-83d73a49aeb6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:19.203081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28487f2-ecf5-4b11-b6e1-b7a8490017cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:19.204066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28487f2-ecf5-4b11-b6e1-b7a8490017cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:19.204314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28487f2-ecf5-4b11-b6e1-b7a8490017cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:19.204699 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28487f2-ecf5-4b11-b6e1-b7a8490017cf admin admin] PATH_INFO: `/v3/projects/1246eb35c5414d1c96a2928aee02f027/users/abc07a8316ad4343ab80a09bd5f3ccb9/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:19.209926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28487f2-ecf5-4b11-b6e1-b7a8490017cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1246eb35c5414d1c96a2928aee02f027, user_id=abc07a8316ad4343ab80a09bd5f3ccb9, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:19.213831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28487f2-ecf5-4b11-b6e1-b7a8490017cf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:19.237381 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1228/2475] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:36:19 2022] PUT /identity/v3/projects/1246eb35c5414d1c96a2928aee02f027/users/abc07a8316ad4343ab80a09bd5f3ccb9/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:22.259655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb75e95-8324-486c-88a3-df90a9a1fbeb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:22.271797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb75e95-8324-486c-88a3-df90a9a1fbeb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:22.359568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:22.361241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:22.362217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:22.363013 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] PATH_INFO: `/v3/users/f1b69b6d5a5f42c6a8c0f552a9c569a5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:22.364855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b69b6d5a5f42c6a8c0f552a9c569a5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:22.367017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:22.426492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:22.440063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b69b6d5a5f42c6a8c0f552a9c569a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:22.452899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b69b6d5a5f42c6a8c0f552a9c569a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:22.453891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b69b6d5a5f42c6a8c0f552a9c569a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:22.464119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b69b6d5a5f42c6a8c0f552a9c569a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:22.472786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b69b6d5a5f42c6a8c0f552a9c569a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:22.482101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1248/2476] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:36:22 2022] DELETE /identity/v3/users/f1b69b6d5a5f42c6a8c0f552a9c569a5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:22.487336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d101-0208-4706-b76d-4de24121dafa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:22.487840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d101-0208-4706-b76d-4de24121dafa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:22.487934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d101-0208-4706-b76d-4de24121dafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:22.512455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f994d101-0208-4706-b76d-4de24121dafa None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:22.514725 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f994d101-0208-4706-b76d-4de24121dafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:22.605206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1229/2477] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:22.616465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:22.618113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:22.707138 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bf97e-fbb5-4157-b370-13fb3315a00c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:22.710966 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3153c-6f36-40ee-b215-9a4fc322f8c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:22.711722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3153c-6f36-40ee-b215-9a4fc322f8c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:22.712685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3153c-6f36-40ee-b215-9a4fc322f8c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:22.712685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3153c-6f36-40ee-b215-9a4fc322f8c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:22.725461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3153c-6f36-40ee-b215-9a4fc322f8c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:22.727364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3153c-6f36-40ee-b215-9a4fc322f8c8 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:22.739202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1249/2478] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:23.251391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994d101-0208-4706-b76d-4de24121dafa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:23.254285 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f994d101-0208-4706-b76d-4de24121dafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:23.272996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994d101-0208-4706-b76d-4de24121dafa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:23.278126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:23.280203 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:23.280203 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:23.280203 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] PATH_INFO: `/v3/projects/7b4f96f4950042888814dc45d308a3d4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:23.281034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4f96f4950042888814dc45d308a3d4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:23.285035 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:23.352474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:23.387954 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4f96f4950042888814dc45d308a3d4', 'request_id': 'req-67c788c4-b52c-4596-8afd-2f688c2fa0fd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:23.398995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4f96f4950042888814dc45d308a3d4', 'request_id': 'req-67c788c4-b52c-4596-8afd-2f688c2fa0fd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:23.426540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4f96f4950042888814dc45d308a3d4', 'request_id': 'req-67c788c4-b52c-4596-8afd-2f688c2fa0fd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:23.444854 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] The token cache is being invalidate because project 7b4f96f4950042888814dc45d308a3d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:36:23.445613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:23.454943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c788c4-b52c-4596-8afd-2f688c2fa0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:23.459402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1230/2479] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:36:23 2022] DELETE /identity/v3/projects/7b4f96f4950042888814dc45d308a3d4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:23.465839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e896a-68a9-45b3-94ce-922d50195f9f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:23.467055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e896a-68a9-45b3-94ce-922d50195f9f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:23.467619 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e896a-68a9-45b3-94ce-922d50195f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:23.495935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-319e896a-68a9-45b3-94ce-922d50195f9f None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:23.497591 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-319e896a-68a9-45b3-94ce-922d50195f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:23.596323 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1250/2480] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:23.604622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7088ff-a39c-4668-a10c-d9c98233cbb9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:23.605698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7088ff-a39c-4668-a10c-d9c98233cbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:23.606158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7088ff-a39c-4668-a10c-d9c98233cbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:23.634308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ea7088ff-a39c-4668-a10c-d9c98233cbb9 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:23.636411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ea7088ff-a39c-4668-a10c-d9c98233cbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:23.650745 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1231/2481] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:23.654934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e896a-68a9-45b3-94ce-922d50195f9f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:23.668420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e896a-68a9-45b3-94ce-922d50195f9f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:23.676496 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3228f-11d8-44e3-90c3-6b326a699572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:23.677396 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3228f-11d8-44e3-90c3-6b326a699572 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:23.677698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3228f-11d8-44e3-90c3-6b326a699572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:23.677977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3228f-11d8-44e3-90c3-6b326a699572 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:23.678765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3228f-11d8-44e3-90c3-6b326a699572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:36:23.679076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3228f-11d8-44e3-90c3-6b326a699572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:23.680763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3228f-11d8-44e3-90c3-6b326a699572 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:23.693836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1251/2482] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:36:23.698280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7088ff-a39c-4668-a10c-d9c98233cbb9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:23.711839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7088ff-a39c-4668-a10c-d9c98233cbb9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:23.725892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617e986-73ef-4de6-954f-6d5d05c28c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:23.726725 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e986-73ef-4de6-954f-6d5d05c28c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:23.727071 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e986-73ef-4de6-954f-6d5d05c28c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:23.727406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e986-73ef-4de6-954f-6d5d05c28c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:23.728197 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617e986-73ef-4de6-954f-6d5d05c28c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:23.730318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617e986-73ef-4de6-954f-6d5d05c28c59 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:23.784919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1232/2483] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:36:23 2022] POST /identity/v3/projects => generated 409 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:23.789236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3228f-11d8-44e3-90c3-6b326a699572 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:23.804421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3228f-11d8-44e3-90c3-6b326a699572 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:23.889239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:23.916143 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb6c54-4fa2-4151-afc5-5dd0f3b90ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:23.917750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb6c54-4fa2-4151-afc5-5dd0f3b90ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:23.918253 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb6c54-4fa2-4151-afc5-5dd0f3b90ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:23.918740 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb6c54-4fa2-4151-afc5-5dd0f3b90ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:23.921324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb6c54-4fa2-4151-afc5-5dd0f3b90ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:23.923329 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb6c54-4fa2-4151-afc5-5dd0f3b90ef6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:23.961080 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1252/2484] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:36:23 2022] POST /identity/v3/users => generated 305 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:23.965242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617e986-73ef-4de6-954f-6d5d05c28c59 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:23.977003 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617e986-73ef-4de6-954f-6d5d05c28c59 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:23.981553 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca13dbf-887c-4327-a142-3ca668e0b817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:23.982354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca13dbf-887c-4327-a142-3ca668e0b817 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:23.982630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca13dbf-887c-4327-a142-3ca668e0b817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:23.982899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca13dbf-887c-4327-a142-3ca668e0b817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:23.983635 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca13dbf-887c-4327-a142-3ca668e0b817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:23.985274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca13dbf-887c-4327-a142-3ca668e0b817 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:23.996577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1233/2485] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:24.000506 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb6c54-4fa2-4151-afc5-5dd0f3b90ef6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:24.010791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb6c54-4fa2-4151-afc5-5dd0f3b90ef6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:24.015550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c2c49-d320-4835-82e8-e60fecb2a4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:24.016228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c2c49-d320-4835-82e8-e60fecb2a4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:24.016508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c2c49-d320-4835-82e8-e60fecb2a4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:24.016781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c2c49-d320-4835-82e8-e60fecb2a4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:24.017562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c2c49-d320-4835-82e8-e60fecb2a4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:24.019168 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c2c49-d320-4835-82e8-e60fecb2a4a9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:24.031192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1253/2486] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:24.035533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca13dbf-887c-4327-a142-3ca668e0b817 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:24.046264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca13dbf-887c-4327-a142-3ca668e0b817 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:24.050949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83713eb-3cde-41df-b9be-afbdbe19c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:24.051848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83713eb-3cde-41df-b9be-afbdbe19c01f admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:24.052127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83713eb-3cde-41df-b9be-afbdbe19c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:24.052405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83713eb-3cde-41df-b9be-afbdbe19c01f admin admin] PATH_INFO: `/v3/projects/f9348353077b4b7386be166894a9480d/users/a5a17abd1baf42efb7da061191b9a4a8/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:24.070580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83713eb-3cde-41df-b9be-afbdbe19c01f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9348353077b4b7386be166894a9480d, user_id=a5a17abd1baf42efb7da061191b9a4a8, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:24.073320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83713eb-3cde-41df-b9be-afbdbe19c01f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:24.089606 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1234/2487] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:36:24 2022] PUT /identity/v3/projects/f9348353077b4b7386be166894a9480d/users/a5a17abd1baf42efb7da061191b9a4a8/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:24.099685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255c77c-28f2-4524-95cf-3a591e4ab7c9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:24.099974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255c77c-28f2-4524-95cf-3a591e4ab7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:24.100605 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255c77c-28f2-4524-95cf-3a591e4ab7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:24.129820 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b255c77c-28f2-4524-95cf-3a591e4ab7c9 None None] MFA Rules not processed for user `a5a17abd1baf42efb7da061191b9a4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:24.131074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b255c77c-28f2-4524-95cf-3a591e4ab7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:24.208905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1254/2488] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:24.214058 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83713eb-3cde-41df-b9be-afbdbe19c01f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:24.292150 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83713eb-3cde-41df-b9be-afbdbe19c01f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:24.298056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0167d-e9dc-46e0-b226-a6be2329d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:24.298743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0167d-e9dc-46e0-b226-a6be2329d052 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:24.299648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0167d-e9dc-46e0-b226-a6be2329d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:24.299648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0167d-e9dc-46e0-b226-a6be2329d052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:24.299998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0167d-e9dc-46e0-b226-a6be2329d052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:24.302667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0167d-e9dc-46e0-b226-a6be2329d052 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:24.335209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1235/2489] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:36:24 2022] POST /identity/v3/projects => generated 407 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:24.339159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255c77c-28f2-4524-95cf-3a591e4ab7c9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:24.351612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255c77c-28f2-4524-95cf-3a591e4ab7c9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:24.429365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68c68b-ea84-4774-afca-fd2d3c2cef3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:24.430532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c68b-ea84-4774-afca-fd2d3c2cef3e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:24.430884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c68b-ea84-4774-afca-fd2d3c2cef3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:24.431405 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c68b-ea84-4774-afca-fd2d3c2cef3e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:24.432266 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68c68b-ea84-4774-afca-fd2d3c2cef3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:24.434408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68c68b-ea84-4774-afca-fd2d3c2cef3e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:24.474446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1255/2490] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:36:24 2022] POST /identity/v3/users => generated 310 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:24.478855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0167d-e9dc-46e0-b226-a6be2329d052 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:24.491586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0167d-e9dc-46e0-b226-a6be2329d052 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:24.505055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4a5e9-69b2-44cd-b9ca-77cb14448a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:24.506316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4a5e9-69b2-44cd-b9ca-77cb14448a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:24.506316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4a5e9-69b2-44cd-b9ca-77cb14448a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:24.506511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4a5e9-69b2-44cd-b9ca-77cb14448a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:24.507840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4a5e9-69b2-44cd-b9ca-77cb14448a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:24.509083 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4a5e9-69b2-44cd-b9ca-77cb14448a30 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:24.531225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1236/2491] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:24.535443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68c68b-ea84-4774-afca-fd2d3c2cef3e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:24.548527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68c68b-ea84-4774-afca-fd2d3c2cef3e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:24.554835 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7915a73-818a-4825-8fd8-a236ce7e82a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:24.556098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7915a73-818a-4825-8fd8-a236ce7e82a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:24.556612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7915a73-818a-4825-8fd8-a236ce7e82a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:24.557134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7915a73-818a-4825-8fd8-a236ce7e82a4 admin admin] PATH_INFO: `/v3/projects/9a28ce349d924193bb7c6ea991684495/users/64ff074818d849a0ab4a5c2d1d8fdc8f/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:24.585113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7915a73-818a-4825-8fd8-a236ce7e82a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a28ce349d924193bb7c6ea991684495, user_id=64ff074818d849a0ab4a5c2d1d8fdc8f, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:24.588055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7915a73-818a-4825-8fd8-a236ce7e82a4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:24.614935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1256/2492] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:36:24 2022] PUT /identity/v3/projects/9a28ce349d924193bb7c6ea991684495/users/64ff074818d849a0ab4a5c2d1d8fdc8f/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:24.617850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4a5e9-69b2-44cd-b9ca-77cb14448a30 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:24.632405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4a5e9-69b2-44cd-b9ca-77cb14448a30 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:24.670140 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:24.708672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385185e0-4236-40e6-a70c-b5bb5f590e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:24.709648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385185e0-4236-40e6-a70c-b5bb5f590e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:24.710199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385185e0-4236-40e6-a70c-b5bb5f590e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:24.710693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385185e0-4236-40e6-a70c-b5bb5f590e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:24.711500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385185e0-4236-40e6-a70c-b5bb5f590e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:24.713205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385185e0-4236-40e6-a70c-b5bb5f590e01 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:24.724321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1237/2493] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:24.728762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7915a73-818a-4825-8fd8-a236ce7e82a4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:24.740616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7915a73-818a-4825-8fd8-a236ce7e82a4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:24.745771 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3fd00-34eb-434a-bb4b-66e502dd0896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:24.746902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3fd00-34eb-434a-bb4b-66e502dd0896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:24.747343 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3fd00-34eb-434a-bb4b-66e502dd0896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:24.747711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3fd00-34eb-434a-bb4b-66e502dd0896 admin admin] PATH_INFO: `/v3/projects/9a28ce349d924193bb7c6ea991684495/users/64ff074818d849a0ab4a5c2d1d8fdc8f/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:24.749756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3fd00-34eb-434a-bb4b-66e502dd0896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a28ce349d924193bb7c6ea991684495, user_id=64ff074818d849a0ab4a5c2d1d8fdc8f, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:24.752495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3fd00-34eb-434a-bb4b-66e502dd0896 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:24.765729 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1257/2494] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:36:24 2022] PUT /identity/v3/projects/9a28ce349d924193bb7c6ea991684495/users/64ff074818d849a0ab4a5c2d1d8fdc8f/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:24.777223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c133fd-c48b-474e-a207-0350903a9784 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:24.777644 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c133fd-c48b-474e-a207-0350903a9784 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:24.778021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c133fd-c48b-474e-a207-0350903a9784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:24.816522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-50c133fd-c48b-474e-a207-0350903a9784 None None] MFA Rules not processed for user `64ff074818d849a0ab4a5c2d1d8fdc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:24.817816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-50c133fd-c48b-474e-a207-0350903a9784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:24.940445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1238/2495] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:24.952098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3fd00-34eb-434a-bb4b-66e502dd0896 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:24.954085 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-22f3fd00-34eb-434a-bb4b-66e502dd0896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:24.960313 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:25.041194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3fd00-34eb-434a-bb4b-66e502dd0896 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:25.052312 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b8131-08ae-4290-bfed-2b4d3874aeb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:25.053409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8131-08ae-4290-bfed-2b4d3874aeb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:25.053903 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8131-08ae-4290-bfed-2b4d3874aeb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:25.054682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8131-08ae-4290-bfed-2b4d3874aeb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:25.066302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b8131-08ae-4290-bfed-2b4d3874aeb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:25.068254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b8131-08ae-4290-bfed-2b4d3874aeb4 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:25.094454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1258/2496] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:24 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:25.289430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c133fd-c48b-474e-a207-0350903a9784 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:25.299455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c133fd-c48b-474e-a207-0350903a9784 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:25.303988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274ff68-f9c6-4ecb-a448-99cbc7c4d68b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:25.304820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ff68-f9c6-4ecb-a448-99cbc7c4d68b service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:25.305346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ff68-f9c6-4ecb-a448-99cbc7c4d68b service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:25.305674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ff68-f9c6-4ecb-a448-99cbc7c4d68b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:25.367894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274ff68-f9c6-4ecb-a448-99cbc7c4d68b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:25.369412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274ff68-f9c6-4ecb-a448-99cbc7c4d68b service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:25.385158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1239/2497] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:25.768474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d33b1-a838-4316-aaec-f6b6482b54d4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:25.769004 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d33b1-a838-4316-aaec-f6b6482b54d4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:25.769106 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d33b1-a838-4316-aaec-f6b6482b54d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:25.825015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-785d33b1-a838-4316-aaec-f6b6482b54d4 None None] MFA Rules not processed for user `abc07a8316ad4343ab80a09bd5f3ccb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:25.825015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-785d33b1-a838-4316-aaec-f6b6482b54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:25.953376 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1259/2498] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:25.962053 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274ff68-f9c6-4ecb-a448-99cbc7c4d68b service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:25.964458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3274ff68-f9c6-4ecb-a448-99cbc7c4d68b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:26.037084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:26.085428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274ff68-f9c6-4ecb-a448-99cbc7c4d68b service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:26.092281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6906-9c56-484d-8a71-1984bfd3f6a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f53619b6994ae0a117549a67fa29a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:26.093614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6906-9c56-484d-8a71-1984bfd3f6a6 service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:26.094002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6906-9c56-484d-8a71-1984bfd3f6a6 service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:26.094370 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6906-9c56-484d-8a71-1984bfd3f6a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:26.097479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e3af6906-9c56-484d-8a71-1984bfd3f6a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:26.198573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af6906-9c56-484d-8a71-1984bfd3f6a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:26.200135 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af6906-9c56-484d-8a71-1984bfd3f6a6 service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:26.210803 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1240/2499] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:36:26.341791 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fce5f2-383d-4e4d-9ca7-5f054fba1ec0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:26.342073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fce5f2-383d-4e4d-9ca7-5f054fba1ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:26.342347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fce5f2-383d-4e4d-9ca7-5f054fba1ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:26.362276 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d8fce5f2-383d-4e4d-9ca7-5f054fba1ec0 None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:26.363677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d8fce5f2-383d-4e4d-9ca7-5f054fba1ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:26.442670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1260/2500] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:36:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:26.504806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6906-9c56-484d-8a71-1984bfd3f6a6 service glance] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:26.506320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e3af6906-9c56-484d-8a71-1984bfd3f6a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:26.600317 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6906-9c56-484d-8a71-1984bfd3f6a6 service glance] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:26.606468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68040383-5d07-47c9-b75e-43914a8e6040 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:26.607237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68040383-5d07-47c9-b75e-43914a8e6040 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:26.607512 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68040383-5d07-47c9-b75e-43914a8e6040 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:26.607782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68040383-5d07-47c9-b75e-43914a8e6040 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:26.617533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68040383-5d07-47c9-b75e-43914a8e6040 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:26.619410 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68040383-5d07-47c9-b75e-43914a8e6040 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:26.633381 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1241/2501] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:36:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:36:30.154654 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fce5f2-383d-4e4d-9ca7-5f054fba1ec0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:30.156709 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d8fce5f2-383d-4e4d-9ca7-5f054fba1ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:30.220028 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:30.240677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fce5f2-383d-4e4d-9ca7-5f054fba1ec0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:30.244795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c48d56-5161-416d-a856-f8250165ba53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:30.245566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c48d56-5161-416d-a856-f8250165ba53 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:30.245843 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c48d56-5161-416d-a856-f8250165ba53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:30.246112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c48d56-5161-416d-a856-f8250165ba53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:30.249897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-20c48d56-5161-416d-a856-f8250165ba53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:30.262200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c48d56-5161-416d-a856-f8250165ba53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:30.264049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c48d56-5161-416d-a856-f8250165ba53 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:30.276058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1261/2502] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:33.243190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68040383-5d07-47c9-b75e-43914a8e6040 service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:33.340020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68040383-5d07-47c9-b75e-43914a8e6040 service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:33.345464 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:33.346442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:33.346862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:33.347162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] PATH_INFO: `/v3/users/a5a17abd1baf42efb7da061191b9a4a8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:33.348371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a17abd1baf42efb7da061191b9a4a8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:33.351375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:33.370961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:33.433646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a17abd1baf42efb7da061191b9a4a8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:33.448428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a17abd1baf42efb7da061191b9a4a8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:33.449435 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a17abd1baf42efb7da061191b9a4a8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:33.450098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a17abd1baf42efb7da061191b9a4a8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:33.464113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a17abd1baf42efb7da061191b9a4a8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:33.497620 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1242/2503] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:36:33 2022] DELETE /identity/v3/users/a5a17abd1baf42efb7da061191b9a4a8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:33.503252 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29a1a-f811-4d83-b252-abf026626024 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:33.504634 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29a1a-f811-4d83-b252-abf026626024 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:33.505090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29a1a-f811-4d83-b252-abf026626024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:33.530102 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-82c29a1a-f811-4d83-b252-abf026626024 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:33.531728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-82c29a1a-f811-4d83-b252-abf026626024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:33.674691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1262/2504] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:33.694166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:33.695770 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:33.815441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c2c4b-7f6a-4193-a456-0668419eb300 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:33.837505 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6de24-002a-4d8e-9d99-559f88f46347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:33.838311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6de24-002a-4d8e-9d99-559f88f46347 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:33.838666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6de24-002a-4d8e-9d99-559f88f46347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:33.839010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6de24-002a-4d8e-9d99-559f88f46347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:33.860402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6de24-002a-4d8e-9d99-559f88f46347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:33.864723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6de24-002a-4d8e-9d99-559f88f46347 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:33.887849 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1243/2505] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:34.521732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c29a1a-f811-4d83-b252-abf026626024 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:34.523803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-82c29a1a-f811-4d83-b252-abf026626024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:34.536792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f217650-bea1-4af8-bd8b-dff3173fbd75 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:34.537648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f217650-bea1-4af8-bd8b-dff3173fbd75 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:34.538073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f217650-bea1-4af8-bd8b-dff3173fbd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:34.559728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2f217650-bea1-4af8-bd8b-dff3173fbd75 None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:34.561247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2f217650-bea1-4af8-bd8b-dff3173fbd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:34.581112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c29a1a-f811-4d83-b252-abf026626024 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:34.593116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:34.594164 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:34.594446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:34.594744 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] PATH_INFO: `/v3/projects/f9348353077b4b7386be166894a9480d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:34.601319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9348353077b4b7386be166894a9480d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:34.603541 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:34.640868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1244/2506] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:36:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:36:34.654430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f217650-bea1-4af8-bd8b-dff3173fbd75 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:34.656349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2f217650-bea1-4af8-bd8b-dff3173fbd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:34.706545 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9348353077b4b7386be166894a9480d', 'request_id': 'req-62c02f0f-2d50-4894-9c9e-26bc9b08e210'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:34.719106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:34.732304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9348353077b4b7386be166894a9480d', 'request_id': 'req-62c02f0f-2d50-4894-9c9e-26bc9b08e210'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:34.739479 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9348353077b4b7386be166894a9480d', 'request_id': 'req-62c02f0f-2d50-4894-9c9e-26bc9b08e210'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:34.755031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] The token cache is being invalidate because project f9348353077b4b7386be166894a9480d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:36:34.755479 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:34.756227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:34.758617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1263/2507] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:36:34 2022] DELETE /identity/v3/projects/f9348353077b4b7386be166894a9480d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:34.762349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:34.766543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:34.768221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f217650-bea1-4af8-bd8b-dff3173fbd75 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:34.892104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c02f0f-2d50-4894-9c9e-26bc9b08e210 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:34.897763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf6ad7-68d1-45d3-8064-78c7b0fc3bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:34.898742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf6ad7-68d1-45d3-8064-78c7b0fc3bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:34.899091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf6ad7-68d1-45d3-8064-78c7b0fc3bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:34.899437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf6ad7-68d1-45d3-8064-78c7b0fc3bee admin admin] PATH_INFO: `/v3/users/64ff074818d849a0ab4a5c2d1d8fdc8f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:34.900717 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf6ad7-68d1-45d3-8064-78c7b0fc3bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ff074818d849a0ab4a5c2d1d8fdc8f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:34.902766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf6ad7-68d1-45d3-8064-78c7b0fc3bee admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:34.906192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:34.916697 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c91f96-77b1-4c25-a5da-4421b6981673 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:34.917684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91f96-77b1-4c25-a5da-4421b6981673 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:34.920408 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91f96-77b1-4c25-a5da-4421b6981673 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:34.920875 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91f96-77b1-4c25-a5da-4421b6981673 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:34.923208 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-63c91f96-77b1-4c25-a5da-4421b6981673 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:34.997766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7bcf6ad7-68d1-45d3-8064-78c7b0fc3bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ff074818d849a0ab4a5c2d1d8fdc8f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:35.006266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c91f96-77b1-4c25-a5da-4421b6981673 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:35.010152 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c91f96-77b1-4c25-a5da-4421b6981673 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:35.020931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7bcf6ad7-68d1-45d3-8064-78c7b0fc3bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ff074818d849a0ab4a5c2d1d8fdc8f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:35.021973 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7bcf6ad7-68d1-45d3-8064-78c7b0fc3bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ff074818d849a0ab4a5c2d1d8fdc8f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:35.028069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1245/2508] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:36:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 20:36:35.038458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7bcf6ad7-68d1-45d3-8064-78c7b0fc3bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ff074818d849a0ab4a5c2d1d8fdc8f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:35.048310 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7bcf6ad7-68d1-45d3-8064-78c7b0fc3bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ff074818d849a0ab4a5c2d1d8fdc8f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:35.056908 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1264/2509] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:36:34 2022] DELETE /identity/v3/users/64ff074818d849a0ab4a5c2d1d8fdc8f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:35.497488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c91f96-77b1-4c25-a5da-4421b6981673 service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:35.522130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c91f96-77b1-4c25-a5da-4421b6981673 service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:35.788869 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:35.790755 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:35.791946 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:35.792417 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] PATH_INFO: `/v3/projects/9a28ce349d924193bb7c6ea991684495` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:35.798158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a28ce349d924193bb7c6ea991684495)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:35.808592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:35.874492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:35.920494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a28ce349d924193bb7c6ea991684495', 'request_id': 'req-e21217ff-0bb9-46df-b60a-ca83886281d8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:35.945511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a28ce349d924193bb7c6ea991684495', 'request_id': 'req-e21217ff-0bb9-46df-b60a-ca83886281d8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:35.952542 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a28ce349d924193bb7c6ea991684495', 'request_id': 'req-e21217ff-0bb9-46df-b60a-ca83886281d8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:35.974985 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] The token cache is being invalidate because project 9a28ce349d924193bb7c6ea991684495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:36:35.975279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:35.975950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e21217ff-0bb9-46df-b60a-ca83886281d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:35.988675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1246/2510] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:36:35 2022] DELETE /identity/v3/projects/9a28ce349d924193bb7c6ea991684495 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:35.993920 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542daf6-1154-4dfc-9d1a-0ace383db193 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:35.994576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542daf6-1154-4dfc-9d1a-0ace383db193 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:35.994576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542daf6-1154-4dfc-9d1a-0ace383db193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:36.036094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1542daf6-1154-4dfc-9d1a-0ace383db193 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:36.038818 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1542daf6-1154-4dfc-9d1a-0ace383db193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:36.215685 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1265/2511] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:36.224942 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b1cf2-ad3e-4e33-9349-f9ae104ea77b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:36.225461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b1cf2-ad3e-4e33-9349-f9ae104ea77b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:36.226186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b1cf2-ad3e-4e33-9349-f9ae104ea77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:36.277981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6d6b1cf2-ad3e-4e33-9349-f9ae104ea77b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:36.300787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6d6b1cf2-ad3e-4e33-9349-f9ae104ea77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:36.313893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542daf6-1154-4dfc-9d1a-0ace383db193 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:36.319933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1542daf6-1154-4dfc-9d1a-0ace383db193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:36.350592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1247/2512] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:36.352134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b1cf2-ad3e-4e33-9349-f9ae104ea77b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:36.383182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b1cf2-ad3e-4e33-9349-f9ae104ea77b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:36.397703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a1b10-0a3d-4f63-bf19-9574d54cfcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:36.398731 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a1b10-0a3d-4f63-bf19-9574d54cfcfe admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:36.399169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a1b10-0a3d-4f63-bf19-9574d54cfcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:36.399596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a1b10-0a3d-4f63-bf19-9574d54cfcfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:36.401807 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a1b10-0a3d-4f63-bf19-9574d54cfcfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:36:36.405341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a1b10-0a3d-4f63-bf19-9574d54cfcfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:36.407200 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a1b10-0a3d-4f63-bf19-9574d54cfcfe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:36.463989 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1248/2513] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:36:36.473186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a1b10-0a3d-4f63-bf19-9574d54cfcfe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:36.506987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a1b10-0a3d-4f63-bf19-9574d54cfcfe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:36.514854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542daf6-1154-4dfc-9d1a-0ace383db193 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:36.532278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46374a0-65db-4223-a2cb-75937191dddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:36.533160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46374a0-65db-4223-a2cb-75937191dddf service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:36.533438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470f0ae-6e8a-47db-8d3e-6969eea36b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:36.533610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46374a0-65db-4223-a2cb-75937191dddf service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:36.533710 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46374a0-65db-4223-a2cb-75937191dddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:36.534142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470f0ae-6e8a-47db-8d3e-6969eea36b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:36.534418 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470f0ae-6e8a-47db-8d3e-6969eea36b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:36.534787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470f0ae-6e8a-47db-8d3e-6969eea36b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:36.535615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470f0ae-6e8a-47db-8d3e-6969eea36b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:36.537789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f46374a0-65db-4223-a2cb-75937191dddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:36.538873 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470f0ae-6e8a-47db-8d3e-6969eea36b6a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:36.565349 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46374a0-65db-4223-a2cb-75937191dddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:36.568595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46374a0-65db-4223-a2cb-75937191dddf service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:36.594292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1266/2514] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:36.620668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46374a0-65db-4223-a2cb-75937191dddf service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:36.629485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1249/2515] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:36:36 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:36:36.634809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46374a0-65db-4223-a2cb-75937191dddf service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:36.653178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:36.828231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a50a8-575b-433e-a460-3b284cdb6799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:36.829283 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a50a8-575b-433e-a460-3b284cdb6799 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:36.829743 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a50a8-575b-433e-a460-3b284cdb6799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:36.830169 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a50a8-575b-433e-a460-3b284cdb6799 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:36.831812 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a50a8-575b-433e-a460-3b284cdb6799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:36.837522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a50a8-575b-433e-a460-3b284cdb6799 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:36.880910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1267/2516] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:36:36 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:36.885938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470f0ae-6e8a-47db-8d3e-6969eea36b6a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:36.904431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470f0ae-6e8a-47db-8d3e-6969eea36b6a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:36.922439 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217926f-1f65-4005-be7b-b1d017619b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:36.923677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217926f-1f65-4005-be7b-b1d017619b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:36.924442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217926f-1f65-4005-be7b-b1d017619b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:36.928169 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217926f-1f65-4005-be7b-b1d017619b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:36.930215 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217926f-1f65-4005-be7b-b1d017619b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:36.933176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217926f-1f65-4005-be7b-b1d017619b76 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:36.957100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1250/2517] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:36.962136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a50a8-575b-433e-a460-3b284cdb6799 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:36.980620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a50a8-575b-433e-a460-3b284cdb6799 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:36.993009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce20a2-7536-413c-97ad-60cc81fa3f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:36.993732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce20a2-7536-413c-97ad-60cc81fa3f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:36.994038 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce20a2-7536-413c-97ad-60cc81fa3f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:36.996758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce20a2-7536-413c-97ad-60cc81fa3f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:36.997706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce20a2-7536-413c-97ad-60cc81fa3f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:37.000893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce20a2-7536-413c-97ad-60cc81fa3f6d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:37.032916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217926f-1f65-4005-be7b-b1d017619b76 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:37.047840 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217926f-1f65-4005-be7b-b1d017619b76 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:37.048669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1268/2518] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:37.054584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb31c-3a30-46a1-b4f6-a7a468896f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:37.055971 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb31c-3a30-46a1-b4f6-a7a468896f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:37.056268 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb31c-3a30-46a1-b4f6-a7a468896f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:37.056527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb31c-3a30-46a1-b4f6-a7a468896f8f admin admin] PATH_INFO: `/v3/projects/e0763e3250464b0bad60624f117c250e/users/f89ea02fc9a541bb919ad2f10a39dc28/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:37.078682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9eb31c-3a30-46a1-b4f6-a7a468896f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0763e3250464b0bad60624f117c250e, user_id=f89ea02fc9a541bb919ad2f10a39dc28, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:37.081361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9eb31c-3a30-46a1-b4f6-a7a468896f8f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:37.117323 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7c063-bf07-4d12-90c2-e336afc43487 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:37.117614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7c063-bf07-4d12-90c2-e336afc43487 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:37.117891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7c063-bf07-4d12-90c2-e336afc43487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:37.121856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1251/2519] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:36:37 2022] PUT /identity/v3/projects/e0763e3250464b0bad60624f117c250e/users/f89ea02fc9a541bb919ad2f10a39dc28/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:37.151579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5ed7c063-bf07-4d12-90c2-e336afc43487 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:37.154459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5ed7c063-bf07-4d12-90c2-e336afc43487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:37.386965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1269/2520] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:37.409652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb31c-3a30-46a1-b4f6-a7a468896f8f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:37.412988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce9eb31c-3a30-46a1-b4f6-a7a468896f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:37.610217 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb31c-3a30-46a1-b4f6-a7a468896f8f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:37.626888 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7ff24-65fb-4090-b934-09818f042ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:37.627744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7ff24-65fb-4090-b934-09818f042ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:37.628143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7ff24-65fb-4090-b934-09818f042ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:37.628601 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7ff24-65fb-4090-b934-09818f042ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:37.647121 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7ff24-65fb-4090-b934-09818f042ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:37.648887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7ff24-65fb-4090-b934-09818f042ad7 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:37.667457 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1252/2521] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:38.677823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994f482-2d9d-44f0-baed-a8a92831ac18 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:38.678294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994f482-2d9d-44f0-baed-a8a92831ac18 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:38.678656 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994f482-2d9d-44f0-baed-a8a92831ac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:38.701338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6994f482-2d9d-44f0-baed-a8a92831ac18 None None] MFA Rules not processed for user `31306b56242f4761980cec667e783af1`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:38.703041 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6994f482-2d9d-44f0-baed-a8a92831ac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:38.795098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1270/2522] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:39.180188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85de55-723d-4943-bdbe-7d459833ac5a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:39.180676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85de55-723d-4943-bdbe-7d459833ac5a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:39.180756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85de55-723d-4943-bdbe-7d459833ac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:39.203112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994f482-2d9d-44f0-baed-a8a92831ac18 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:39.204585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6994f482-2d9d-44f0-baed-a8a92831ac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:39.218069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994f482-2d9d-44f0-baed-a8a92831ac18 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:39.219588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8a85de55-723d-4943-bdbe-7d459833ac5a None None] MFA Rules not processed for user `f89ea02fc9a541bb919ad2f10a39dc28`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:39.221062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8a85de55-723d-4943-bdbe-7d459833ac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:39.222446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ee5e1-ad93-4754-afa7-53da8bc7b17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:39.223170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ee5e1-ad93-4754-afa7-53da8bc7b17f service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:39.227212 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ee5e1-ad93-4754-afa7-53da8bc7b17f service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:39.227486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ee5e1-ad93-4754-afa7-53da8bc7b17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:39.230001 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-381ee5e1-ad93-4754-afa7-53da8bc7b17f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:39.247687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ee5e1-ad93-4754-afa7-53da8bc7b17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:39.250855 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ee5e1-ad93-4754-afa7-53da8bc7b17f service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:39.259232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:39.266936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1271/2523] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:36:39.322996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1253/2524] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:36:39.327890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ee5e1-ad93-4754-afa7-53da8bc7b17f service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:39.345771 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ee5e1-ad93-4754-afa7-53da8bc7b17f service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:39.351929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c710161-8c3a-42f1-a0c2-7349cf8d4097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:39.353139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710161-8c3a-42f1-a0c2-7349cf8d4097 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:39.353421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710161-8c3a-42f1-a0c2-7349cf8d4097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:39.353693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710161-8c3a-42f1-a0c2-7349cf8d4097 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:39.354400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c710161-8c3a-42f1-a0c2-7349cf8d4097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:39.357392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c710161-8c3a-42f1-a0c2-7349cf8d4097 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:39.379901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:39.401663 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1272/2525] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:36:39 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:39.403692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85de55-723d-4943-bdbe-7d459833ac5a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:39.417730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85de55-723d-4943-bdbe-7d459833ac5a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:39.555297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6e4a-ba33-412b-8fc7-ac6da7e31746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:39.556028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6e4a-ba33-412b-8fc7-ac6da7e31746 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:39.556289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6e4a-ba33-412b-8fc7-ac6da7e31746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:39.556565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6e4a-ba33-412b-8fc7-ac6da7e31746 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:39.557454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe6e4a-ba33-412b-8fc7-ac6da7e31746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:39.559516 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe6e4a-ba33-412b-8fc7-ac6da7e31746 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:39.603639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1254/2526] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:36:39 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:39.607939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c710161-8c3a-42f1-a0c2-7349cf8d4097 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:39.620973 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c710161-8c3a-42f1-a0c2-7349cf8d4097 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:39.627352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d2857-187e-4576-a818-1cf22f0dc714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:39.628205 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d2857-187e-4576-a818-1cf22f0dc714 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:39.628550 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d2857-187e-4576-a818-1cf22f0dc714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:39.628889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d2857-187e-4576-a818-1cf22f0dc714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:39.629881 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d2857-187e-4576-a818-1cf22f0dc714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:39.631591 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d2857-187e-4576-a818-1cf22f0dc714 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:39.648571 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1273/2527] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:39.654320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6e4a-ba33-412b-8fc7-ac6da7e31746 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:39.671794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6e4a-ba33-412b-8fc7-ac6da7e31746 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:39.677205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb8176-3301-41cf-ad13-6c0a248fe1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:39.678181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb8176-3301-41cf-ad13-6c0a248fe1a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:39.678614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb8176-3301-41cf-ad13-6c0a248fe1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:39.679521 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb8176-3301-41cf-ad13-6c0a248fe1a2 admin admin] PATH_INFO: `/v3/projects/6121203eda8c4155b6419a1f7d0ff503/users/6744feaf10f647b89a48edb9f528fa3f/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:39.718296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb8176-3301-41cf-ad13-6c0a248fe1a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6121203eda8c4155b6419a1f7d0ff503, user_id=6744feaf10f647b89a48edb9f528fa3f, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:39.721596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb8176-3301-41cf-ad13-6c0a248fe1a2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:39.749316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1255/2528] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:36:39 2022] PUT /identity/v3/projects/6121203eda8c4155b6419a1f7d0ff503/users/6744feaf10f647b89a48edb9f528fa3f/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:39.749650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d2857-187e-4576-a818-1cf22f0dc714 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:39.762109 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d2857-187e-4576-a818-1cf22f0dc714 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:39.875879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb87a01-3a98-4d42-a6cf-5568c74abafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:39.876702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb87a01-3a98-4d42-a6cf-5568c74abafe admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:39.877097 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb87a01-3a98-4d42-a6cf-5568c74abafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:39.877450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb87a01-3a98-4d42-a6cf-5568c74abafe admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:39.878286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb87a01-3a98-4d42-a6cf-5568c74abafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:39.880336 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb87a01-3a98-4d42-a6cf-5568c74abafe admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:39.895301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1274/2529] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:36:39.897493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb8176-3301-41cf-ad13-6c0a248fe1a2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:39.922106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb8176-3301-41cf-ad13-6c0a248fe1a2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:39.929764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53423e-cc27-4555-84b6-7c7f86e2df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:39.931333 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53423e-cc27-4555-84b6-7c7f86e2df7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:39.932576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53423e-cc27-4555-84b6-7c7f86e2df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:39.933045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53423e-cc27-4555-84b6-7c7f86e2df7d admin admin] PATH_INFO: `/v3/projects/6121203eda8c4155b6419a1f7d0ff503/users/6744feaf10f647b89a48edb9f528fa3f/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:39.935218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53423e-cc27-4555-84b6-7c7f86e2df7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6121203eda8c4155b6419a1f7d0ff503, user_id=6744feaf10f647b89a48edb9f528fa3f, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:39.938139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53423e-cc27-4555-84b6-7c7f86e2df7d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:39.968523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1256/2530] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:36:39 2022] PUT /identity/v3/projects/6121203eda8c4155b6419a1f7d0ff503/users/6744feaf10f647b89a48edb9f528fa3f/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:40.928773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc26991-cc83-4e1a-8430-c0e91d81628a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:40.929705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc26991-cc83-4e1a-8430-c0e91d81628a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:40.930237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc26991-cc83-4e1a-8430-c0e91d81628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:40.990353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8dc26991-cc83-4e1a-8430-c0e91d81628a None None] MFA Rules not processed for user `6744feaf10f647b89a48edb9f528fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:40.992682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8dc26991-cc83-4e1a-8430-c0e91d81628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:41.149071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1275/2531] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:36:41.156894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53423e-cc27-4555-84b6-7c7f86e2df7d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:41.159923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3d53423e-cc27-4555-84b6-7c7f86e2df7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:41.288254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53423e-cc27-4555-84b6-7c7f86e2df7d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:41.304359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87661a0f-1c5d-4b76-b40a-6a43af6a4514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:41.305098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661a0f-1c5d-4b76-b40a-6a43af6a4514 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:41.305374 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661a0f-1c5d-4b76-b40a-6a43af6a4514 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:41.305638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661a0f-1c5d-4b76-b40a-6a43af6a4514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:41.365355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:41.422305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9223bf9-f386-465a-b19e-966e57d3c574 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:41.422595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9223bf9-f386-465a-b19e-966e57d3c574 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:41.422869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9223bf9-f386-465a-b19e-966e57d3c574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:41.426082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87661a0f-1c5d-4b76-b40a-6a43af6a4514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:41.431935 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87661a0f-1c5d-4b76-b40a-6a43af6a4514 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:41.459649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1257/2532] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:41.462142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d9223bf9-f386-465a-b19e-966e57d3c574 None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:41.463501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d9223bf9-f386-465a-b19e-966e57d3c574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:41.546798 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1276/2533] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:36:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:41.570525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87661a0f-1c5d-4b76-b40a-6a43af6a4514 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:41.572011 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-87661a0f-1c5d-4b76-b40a-6a43af6a4514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:41.712860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87661a0f-1c5d-4b76-b40a-6a43af6a4514 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:41.719272 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700cab8-bf00-4874-acad-69e36caecc39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:41.720032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700cab8-bf00-4874-acad-69e36caecc39 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:41.720624 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700cab8-bf00-4874-acad-69e36caecc39 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:41.721290 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700cab8-bf00-4874-acad-69e36caecc39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:41.732562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700cab8-bf00-4874-acad-69e36caecc39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:41.734488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700cab8-bf00-4874-acad-69e36caecc39 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:41.744880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1258/2534] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:36:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:36:43.068054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9223bf9-f386-465a-b19e-966e57d3c574 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:43.071521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d9223bf9-f386-465a-b19e-966e57d3c574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:43.093282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9223bf9-f386-465a-b19e-966e57d3c574 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:43.117423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdc6f8-b006-40dc-98c8-bf8bcda2e281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:43.120798 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdc6f8-b006-40dc-98c8-bf8bcda2e281 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:43.122002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdc6f8-b006-40dc-98c8-bf8bcda2e281 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:43.133051 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdc6f8-b006-40dc-98c8-bf8bcda2e281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:43.156265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdc6f8-b006-40dc-98c8-bf8bcda2e281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:43.158569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdc6f8-b006-40dc-98c8-bf8bcda2e281 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:43.180607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:43.200193 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1277/2535] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:43.543368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700cab8-bf00-4874-acad-69e36caecc39 service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:43.710726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700cab8-bf00-4874-acad-69e36caecc39 service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:43.729622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ad60e-62e6-4aa9-a389-253d9422970a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:43.729898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ad60e-62e6-4aa9-a389-253d9422970a service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:43.730151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ad60e-62e6-4aa9-a389-253d9422970a service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:43.730573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ad60e-62e6-4aa9-a389-253d9422970a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:43.750220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-784ad60e-62e6-4aa9-a389-253d9422970a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:43.796207 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ad60e-62e6-4aa9-a389-253d9422970a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:43.800589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ad60e-62e6-4aa9-a389-253d9422970a service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:43.844938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1259/2536] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:53.188446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:53.842690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=78 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:57.668059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdc6f8-b006-40dc-98c8-bf8bcda2e281 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:57.669611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c3bdc6f8-b006-40dc-98c8-bf8bcda2e281 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:57.745267 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ad60e-62e6-4aa9-a389-253d9422970a service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:57.748098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdc6f8-b006-40dc-98c8-bf8bcda2e281 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:57.753237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d206646-563c-4101-8862-a532766ee8d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df36a267464042908bbd8eebc7c40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:57.753901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d206646-563c-4101-8862-a532766ee8d0 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:57.754203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d206646-563c-4101-8862-a532766ee8d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:57.754473 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d206646-563c-4101-8862-a532766ee8d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:57.756263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4d206646-563c-4101-8862-a532766ee8d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:57.769592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d206646-563c-4101-8862-a532766ee8d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:57.771189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d206646-563c-4101-8862-a532766ee8d0 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:57.781494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1278/2537] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:57.833484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ad60e-62e6-4aa9-a389-253d9422970a service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:57.837961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:57.838855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:57.839129 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:57.839547 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] PATH_INFO: `/v3/users/f89ea02fc9a541bb919ad2f10a39dc28` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:57.840750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f89ea02fc9a541bb919ad2f10a39dc28)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:57.842726 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:57.893499 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89ea02fc9a541bb919ad2f10a39dc28'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:57.901673 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d206646-563c-4101-8862-a532766ee8d0 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:57.913273 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89ea02fc9a541bb919ad2f10a39dc28'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:57.914850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89ea02fc9a541bb919ad2f10a39dc28'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:57.915723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89ea02fc9a541bb919ad2f10a39dc28'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:57.916579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d206646-563c-4101-8862-a532766ee8d0 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:57.925467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8e77-9d1a-4a66-9868-0978d9dffa56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:57.926170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8e77-9d1a-4a66-9868-0978d9dffa56 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:57.926515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8e77-9d1a-4a66-9868-0978d9dffa56 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:57.926980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8e77-9d1a-4a66-9868-0978d9dffa56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:57.928758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89ea02fc9a541bb919ad2f10a39dc28'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:57.928987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6afb8e77-9d1a-4a66-9868-0978d9dffa56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:57.942612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb8e77-9d1a-4a66-9868-0978d9dffa56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:57.944208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb8e77-9d1a-4a66-9868-0978d9dffa56 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:57.964753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1260/2538] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:36:57 2022] DELETE /identity/v3/users/f89ea02fc9a541bb919ad2f10a39dc28 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:57.975662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1279/2539] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:36:58.152986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:58.154500 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:58.247898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ad18a-e93d-4684-bb74-ca5aecb2fdae admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:58.253379 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:58.254389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:58.254752 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:58.255059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] PATH_INFO: `/v3/projects/e0763e3250464b0bad60624f117c250e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:58.256326 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0763e3250464b0bad60624f117c250e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:58.258335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:58.285868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:58.314158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0763e3250464b0bad60624f117c250e', 'request_id': 'req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.324853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0763e3250464b0bad60624f117c250e', 'request_id': 'req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.330582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0763e3250464b0bad60624f117c250e', 'request_id': 'req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.341649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] The token cache is being invalidate because project e0763e3250464b0bad60624f117c250e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:36:58.341936 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.342575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.344200 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1261/2540] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:36:58 2022] DELETE /identity/v3/projects/e0763e3250464b0bad60624f117c250e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:58.348686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8e77-9d1a-4a66-9868-0978d9dffa56 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:58.359978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8e77-9d1a-4a66-9868-0978d9dffa56 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:58.418094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7f61f-7742-42f7-bf53-612d51cc9b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:58.418893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7f61f-7742-42f7-bf53-612d51cc9b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:58.419173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7f61f-7742-42f7-bf53-612d51cc9b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:58.419660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7f61f-7742-42f7-bf53-612d51cc9b2f admin admin] PATH_INFO: `/v3/users/6744feaf10f647b89a48edb9f528fa3f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:58.420892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7f61f-7742-42f7-bf53-612d51cc9b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6744feaf10f647b89a48edb9f528fa3f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:58.423129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7f61f-7742-42f7-bf53-612d51cc9b2f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:58.478302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cba7f61f-7742-42f7-bf53-612d51cc9b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6744feaf10f647b89a48edb9f528fa3f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.494280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cba7f61f-7742-42f7-bf53-612d51cc9b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6744feaf10f647b89a48edb9f528fa3f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.495005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cba7f61f-7742-42f7-bf53-612d51cc9b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6744feaf10f647b89a48edb9f528fa3f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.505391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cba7f61f-7742-42f7-bf53-612d51cc9b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6744feaf10f647b89a48edb9f528fa3f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.511392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:58.513667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cba7f61f-7742-42f7-bf53-612d51cc9b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6744feaf10f647b89a48edb9f528fa3f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.521575 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1280/2541] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:36:58 2022] DELETE /identity/v3/users/6744feaf10f647b89a48edb9f528fa3f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:58.700622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:58.702102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:58.715527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a1904-d2f6-4bbf-95e7-cd4852cfd8e7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:58.777688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:58.778569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:58.778850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:58.779124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] PATH_INFO: `/v3/projects/6121203eda8c4155b6419a1f7d0ff503` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:58.780339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6121203eda8c4155b6419a1f7d0ff503)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:58.782334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:58.835580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6121203eda8c4155b6419a1f7d0ff503', 'request_id': 'req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.843945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6121203eda8c4155b6419a1f7d0ff503', 'request_id': 'req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.850454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6121203eda8c4155b6419a1f7d0ff503', 'request_id': 'req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.862541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] The token cache is being invalidate because project 6121203eda8c4155b6419a1f7d0ff503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:36:58.862929 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.863818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-474a8d42-2ee0-42f6-98c0-2d79bc69bb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:36:58.865372 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1262/2542] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:36:58 2022] DELETE /identity/v3/projects/6121203eda8c4155b6419a1f7d0ff503 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:58.870799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5c49-38b0-46f8-95d6-72a93bce3714 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:58.871339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5c49-38b0-46f8-95d6-72a93bce3714 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:58.871454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5c49-38b0-46f8-95d6-72a93bce3714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:58.890662 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2e8f5c49-38b0-46f8-95d6-72a93bce3714 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:58.891867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2e8f5c49-38b0-46f8-95d6-72a93bce3714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:58.955466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1281/2543] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:36:58.963366 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b41ac-3171-4189-91a3-3532e310c7ca None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:58.963655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b41ac-3171-4189-91a3-3532e310c7ca None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:58.963934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b41ac-3171-4189-91a3-3532e310c7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:58.983648 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-957b41ac-3171-4189-91a3-3532e310c7ca None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:58.984864 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-957b41ac-3171-4189-91a3-3532e310c7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:58.993491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1263/2544] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:58.997848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5c49-38b0-46f8-95d6-72a93bce3714 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:59.007772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5c49-38b0-46f8-95d6-72a93bce3714 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:59.012512 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463654a0-ef33-49d2-8f01-991e3f2a0eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:59.013334 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463654a0-ef33-49d2-8f01-991e3f2a0eac admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.013617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463654a0-ef33-49d2-8f01-991e3f2a0eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.013889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463654a0-ef33-49d2-8f01-991e3f2a0eac admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.014630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463654a0-ef33-49d2-8f01-991e3f2a0eac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:36:59.014935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463654a0-ef33-49d2-8f01-991e3f2a0eac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:59.016517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463654a0-ef33-49d2-8f01-991e3f2a0eac admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:59.030250 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1282/2545] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:36:59.034212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b41ac-3171-4189-91a3-3532e310c7ca None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:59.043599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b41ac-3171-4189-91a3-3532e310c7ca None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:59.048172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3dc79-6c94-490e-8bc2-983504ba757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:59.048832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3dc79-6c94-490e-8bc2-983504ba757b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.049215 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3dc79-6c94-490e-8bc2-983504ba757b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.049492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3dc79-6c94-490e-8bc2-983504ba757b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.050200 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3dc79-6c94-490e-8bc2-983504ba757b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:59.052127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3dc79-6c94-490e-8bc2-983504ba757b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:59.080754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1264/2546] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:36:59 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:59.084803 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463654a0-ef33-49d2-8f01-991e3f2a0eac admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:59.095477 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463654a0-ef33-49d2-8f01-991e3f2a0eac admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:59.156021 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91935c05-3561-4fb6-93e0-c7e21972018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:59.156733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91935c05-3561-4fb6-93e0-c7e21972018e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.157056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91935c05-3561-4fb6-93e0-c7e21972018e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.157332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91935c05-3561-4fb6-93e0-c7e21972018e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.158031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91935c05-3561-4fb6-93e0-c7e21972018e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:59.159971 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91935c05-3561-4fb6-93e0-c7e21972018e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:59.181686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1283/2547] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:36:59 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:36:59.185890 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3dc79-6c94-490e-8bc2-983504ba757b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:59.196475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3dc79-6c94-490e-8bc2-983504ba757b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:59.201814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e8730-90a4-44ad-adbe-e734ab6e0cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:59.202498 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8730-90a4-44ad-adbe-e734ab6e0cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.202784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8730-90a4-44ad-adbe-e734ab6e0cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.203144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8730-90a4-44ad-adbe-e734ab6e0cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.203969 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e8730-90a4-44ad-adbe-e734ab6e0cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:59.205679 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e8730-90a4-44ad-adbe-e734ab6e0cbf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:59.211977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:59.217698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1265/2548] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:36:59.222327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91935c05-3561-4fb6-93e0-c7e21972018e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:59.233660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91935c05-3561-4fb6-93e0-c7e21972018e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:59.238289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12de36-fa67-43ac-bf45-d1bdcc7af418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:59.238965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12de36-fa67-43ac-bf45-d1bdcc7af418 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.239258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12de36-fa67-43ac-bf45-d1bdcc7af418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.239536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12de36-fa67-43ac-bf45-d1bdcc7af418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.240293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12de36-fa67-43ac-bf45-d1bdcc7af418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:59.241975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12de36-fa67-43ac-bf45-d1bdcc7af418 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:59.253295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1284/2549] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:59.256698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e8730-90a4-44ad-adbe-e734ab6e0cbf admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:59.266980 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e8730-90a4-44ad-adbe-e734ab6e0cbf admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:59.271832 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3869e99-a2b5-4401-b3b3-6bc6b15966c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:59.272756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3869e99-a2b5-4401-b3b3-6bc6b15966c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.273120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3869e99-a2b5-4401-b3b3-6bc6b15966c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.273409 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3869e99-a2b5-4401-b3b3-6bc6b15966c6 admin admin] PATH_INFO: `/v3/projects/b9f8bb72223944baba30e3ba102b5847/users/bad783c1512c4f8e9516df931ffb13c3/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.289402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3869e99-a2b5-4401-b3b3-6bc6b15966c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f8bb72223944baba30e3ba102b5847, user_id=bad783c1512c4f8e9516df931ffb13c3, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:59.292065 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3869e99-a2b5-4401-b3b3-6bc6b15966c6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:59.306485 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1266/2550] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:36:59 2022] PUT /identity/v3/projects/b9f8bb72223944baba30e3ba102b5847/users/bad783c1512c4f8e9516df931ffb13c3/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:36:59.318522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0994ea-75a3-42fa-aacd-0605017856a4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.318910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0994ea-75a3-42fa-aacd-0605017856a4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.319187 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0994ea-75a3-42fa-aacd-0605017856a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.349241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cc0994ea-75a3-42fa-aacd-0605017856a4 None None] MFA Rules not processed for user `bad783c1512c4f8e9516df931ffb13c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:59.350593 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cc0994ea-75a3-42fa-aacd-0605017856a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:59.407006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:59.429074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1285/2551] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:36:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:59.440771 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3869e99-a2b5-4401-b3b3-6bc6b15966c6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:59.442566 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e3869e99-a2b5-4401-b3b3-6bc6b15966c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:59.509758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3869e99-a2b5-4401-b3b3-6bc6b15966c6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:59.513749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5415ff-fa6d-40b1-8859-eaa8744c76fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f53619b6994ae0a117549a67fa29a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:59.514410 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5415ff-fa6d-40b1-8859-eaa8744c76fe service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.514689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5415ff-fa6d-40b1-8859-eaa8744c76fe service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.514957 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5415ff-fa6d-40b1-8859-eaa8744c76fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.523523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5415ff-fa6d-40b1-8859-eaa8744c76fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:59.525028 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5415ff-fa6d-40b1-8859-eaa8744c76fe service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:59.534848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1267/2552] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:59.563664 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e9663-0a90-420d-8e8e-8d9aa1e9eae3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.564026 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e9663-0a90-420d-8e8e-8d9aa1e9eae3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.564236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e9663-0a90-420d-8e8e-8d9aa1e9eae3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.565693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1286/2553] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:36:59.573404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c998-791a-4f3e-a405-11f1cd0829f9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.573404 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c998-791a-4f3e-a405-11f1cd0829f9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.573755 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c998-791a-4f3e-a405-11f1cd0829f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.597814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-79f9c998-791a-4f3e-a405-11f1cd0829f9 None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:59.601872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-79f9c998-791a-4f3e-a405-11f1cd0829f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:59.686295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1268/2554] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:36:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:36:59.698614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e9663-0a90-420d-8e8e-8d9aa1e9eae3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:59.700787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-144e9663-0a90-420d-8e8e-8d9aa1e9eae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:59.715285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e9663-0a90-420d-8e8e-8d9aa1e9eae3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:59.718459 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbd670-fc77-4ce6-853c-b93911176cf1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f53619b6994ae0a117549a67fa29a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:59.719360 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbd670-fc77-4ce6-853c-b93911176cf1 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.719360 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbd670-fc77-4ce6-853c-b93911176cf1 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.719647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbd670-fc77-4ce6-853c-b93911176cf1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.738828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbd670-fc77-4ce6-853c-b93911176cf1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:59.738828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbd670-fc77-4ce6-853c-b93911176cf1 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:59.744246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1287/2555] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:59.811590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a64d-76ba-4e25-8360-e77ecdcc90c7 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.812119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a64d-76ba-4e25-8360-e77ecdcc90c7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.812119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a64d-76ba-4e25-8360-e77ecdcc90c7 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.813793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1269/2556] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:36:59.818735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67dc93-694a-45fa-9470-c77a81a3624c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.819021 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67dc93-694a-45fa-9470-c77a81a3624c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.819294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67dc93-694a-45fa-9470-c77a81a3624c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.837782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3b67dc93-694a-45fa-9470-c77a81a3624c None None] MFA Rules not processed for user `1c5ad3094ee04495a6ab82c92d458aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:59.839100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3b67dc93-694a-45fa-9470-c77a81a3624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:59.904079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1288/2557] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:36:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:59.916011 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4a64d-76ba-4e25-8360-e77ecdcc90c7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:59.917892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7aa4a64d-76ba-4e25-8360-e77ecdcc90c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:59.933446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4a64d-76ba-4e25-8360-e77ecdcc90c7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:59.936943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906530e-2442-4ed7-ad7b-24c5d6dd5fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:59.937622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906530e-2442-4ed7-ad7b-24c5d6dd5fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:59.937909 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906530e-2442-4ed7-ad7b-24c5d6dd5fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:59.938185 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906530e-2442-4ed7-ad7b-24c5d6dd5fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:59.946307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906530e-2442-4ed7-ad7b-24c5d6dd5fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:59.947747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906530e-2442-4ed7-ad7b-24c5d6dd5fc8 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:59.956149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1270/2558] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:00.074167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f483-ff9b-4c66-af22-28f33e692177 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:00.074454 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f483-ff9b-4c66-af22-28f33e692177 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:00.074735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f483-ff9b-4c66-af22-28f33e692177 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:00.076120 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1289/2559] 10.222.0.30 () {54 vars in 921 bytes} [Wed Jul 6 20:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:37:00.081938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182efa-347c-4266-8f26-23d5c0e5a824 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:00.082332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182efa-347c-4266-8f26-23d5c0e5a824 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:00.082617 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182efa-347c-4266-8f26-23d5c0e5a824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:00.102047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-63182efa-347c-4266-8f26-23d5c0e5a824 None None] MFA Rules not processed for user `56ad461f6dc54014a956e5c8a094352c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:00.103264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-63182efa-347c-4266-8f26-23d5c0e5a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:00.112635 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1271/2560] 10.222.0.30 () {58 vars in 1018 bytes} [Wed Jul 6 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:37:00.123444 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045f483-ff9b-4c66-af22-28f33e692177 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:00.125608 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1045f483-ff9b-4c66-af22-28f33e692177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:00.140096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045f483-ff9b-4c66-af22-28f33e692177 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:00.144134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e1127-e0f5-424a-9914-a48a9d1e9682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:00.144777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1127-e0f5-424a-9914-a48a9d1e9682 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:00.145099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1127-e0f5-424a-9914-a48a9d1e9682 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:00.145372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1127-e0f5-424a-9914-a48a9d1e9682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:00.157134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e1127-e0f5-424a-9914-a48a9d1e9682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:00.158566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e1127-e0f5-424a-9914-a48a9d1e9682 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:00.170150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1290/2561] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:01.994369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447138-17b5-4e7b-9e24-91ce99cf7507 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:01.995324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447138-17b5-4e7b-9e24-91ce99cf7507 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:01.995667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447138-17b5-4e7b-9e24-91ce99cf7507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:02.014651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-44447138-17b5-4e7b-9e24-91ce99cf7507 None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:02.015874 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-44447138-17b5-4e7b-9e24-91ce99cf7507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:02.073818 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:02.087433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1272/2562] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:37:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:02.104106 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e1127-e0f5-424a-9914-a48a9d1e9682 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:02.106200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a17e1127-e0f5-424a-9914-a48a9d1e9682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:02.187790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e1127-e0f5-424a-9914-a48a9d1e9682 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:02.193645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54013d9a-beb5-443b-9f05-dd34b2e4b084 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:02.194359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54013d9a-beb5-443b-9f05-dd34b2e4b084 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:02.194635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54013d9a-beb5-443b-9f05-dd34b2e4b084 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:02.194890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54013d9a-beb5-443b-9f05-dd34b2e4b084 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:02.204782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54013d9a-beb5-443b-9f05-dd34b2e4b084 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:02.206431 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54013d9a-beb5-443b-9f05-dd34b2e4b084 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:02.215173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1291/2563] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:37:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:37:12.088509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:12.211914 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=71 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:16.214766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44447138-17b5-4e7b-9e24-91ce99cf7507 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:16.303492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44447138-17b5-4e7b-9e24-91ce99cf7507 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:16.308891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:16.310196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:16.310510 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:16.310747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] PATH_INFO: `/v3/users/bad783c1512c4f8e9516df931ffb13c3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:16.313056 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad783c1512c4f8e9516df931ffb13c3)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:16.315650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:16.366229 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad783c1512c4f8e9516df931ffb13c3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:16.378441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad783c1512c4f8e9516df931ffb13c3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:16.379046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad783c1512c4f8e9516df931ffb13c3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:16.379653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad783c1512c4f8e9516df931ffb13c3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:16.387372 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad783c1512c4f8e9516df931ffb13c3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:16.399385 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1273/2564] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:37:16 2022] DELETE /identity/v3/users/bad783c1512c4f8e9516df931ffb13c3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:16.404185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c4937-1f41-4964-bb26-05dccd3a4b88 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:16.404705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c4937-1f41-4964-bb26-05dccd3a4b88 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:16.404705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c4937-1f41-4964-bb26-05dccd3a4b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:16.421747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-690c4937-1f41-4964-bb26-05dccd3a4b88 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:16.422998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-690c4937-1f41-4964-bb26-05dccd3a4b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:16.485440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1292/2565] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:16.495663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:16.497725 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:16.555489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1927c-990e-47dc-8cba-487f82781487 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:16.560780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68232f-8c88-4612-bb8f-e6a7f4ded8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:16.561551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68232f-8c88-4612-bb8f-e6a7f4ded8aa service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:16.561835 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68232f-8c88-4612-bb8f-e6a7f4ded8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:16.562104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68232f-8c88-4612-bb8f-e6a7f4ded8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:16.573938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68232f-8c88-4612-bb8f-e6a7f4ded8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:16.575693 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68232f-8c88-4612-bb8f-e6a7f4ded8aa service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:16.586589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1274/2566] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:16.883045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c4937-1f41-4964-bb26-05dccd3a4b88 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:16.884559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-690c4937-1f41-4964-bb26-05dccd3a4b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:16.897029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c4937-1f41-4964-bb26-05dccd3a4b88 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:16.903415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:16.904293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:16.904565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:16.904824 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] PATH_INFO: `/v3/projects/b9f8bb72223944baba30e3ba102b5847` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:16.906207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f8bb72223944baba30e3ba102b5847)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:16.908118 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:16.959112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f8bb72223944baba30e3ba102b5847', 'request_id': 'req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:16.967455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f8bb72223944baba30e3ba102b5847', 'request_id': 'req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:16.974415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f8bb72223944baba30e3ba102b5847', 'request_id': 'req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:16.985197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] The token cache is being invalidate because project b9f8bb72223944baba30e3ba102b5847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:37:16.985486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:16.986105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1dddeb3c-2a32-422a-b1a4-3b7a00d1fd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:16.987667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1293/2567] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:37:16 2022] DELETE /identity/v3/projects/b9f8bb72223944baba30e3ba102b5847 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:16.993943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f05ae-1b1a-4879-86d2-6b875a59160b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:16.994231 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f05ae-1b1a-4879-86d2-6b875a59160b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:16.994508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f05ae-1b1a-4879-86d2-6b875a59160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.012707 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-224f05ae-1b1a-4879-86d2-6b875a59160b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:17.013952 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-224f05ae-1b1a-4879-86d2-6b875a59160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:17.032446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:17.077256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1275/2568] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:17.085671 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc3fc9-9c3d-46d5-ac4b-3c04350395f7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:17.085960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc3fc9-9c3d-46d5-ac4b-3c04350395f7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:17.086238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc3fc9-9c3d-46d5-ac4b-3c04350395f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.107254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1ebc3fc9-9c3d-46d5-ac4b-3c04350395f7 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:17.108478 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1ebc3fc9-9c3d-46d5-ac4b-3c04350395f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:17.117440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1294/2569] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:17.121858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f05ae-1b1a-4879-86d2-6b875a59160b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:17.132064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f05ae-1b1a-4879-86d2-6b875a59160b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:17.137534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49e357-48a2-461d-8f33-11ee7385678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:17.138196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49e357-48a2-461d-8f33-11ee7385678a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:17.138477 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49e357-48a2-461d-8f33-11ee7385678a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:17.138753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49e357-48a2-461d-8f33-11ee7385678a admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.139491 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49e357-48a2-461d-8f33-11ee7385678a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:37:17.139800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49e357-48a2-461d-8f33-11ee7385678a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:17.141467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49e357-48a2-461d-8f33-11ee7385678a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:17.154624 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1276/2570] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:37:17.160304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc3fc9-9c3d-46d5-ac4b-3c04350395f7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:17.170180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc3fc9-9c3d-46d5-ac4b-3c04350395f7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:17.176113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3794d-a423-493d-a8fa-56171b5d0e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:17.176775 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3794d-a423-493d-a8fa-56171b5d0e04 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:17.177088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3794d-a423-493d-a8fa-56171b5d0e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:17.177362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3794d-a423-493d-a8fa-56171b5d0e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.178055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3794d-a423-493d-a8fa-56171b5d0e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:17.180030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3794d-a423-493d-a8fa-56171b5d0e04 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:17.223365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1295/2571] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:37:17 2022] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:37:17.224583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49e357-48a2-461d-8f33-11ee7385678a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:17.234850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49e357-48a2-461d-8f33-11ee7385678a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:17.304128 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267255b-3bb4-4880-bb75-655fc8e6ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:17.304921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267255b-3bb4-4880-bb75-655fc8e6ac79 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:17.305307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267255b-3bb4-4880-bb75-655fc8e6ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:17.305651 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267255b-3bb4-4880-bb75-655fc8e6ac79 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.306474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267255b-3bb4-4880-bb75-655fc8e6ac79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:17.308708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267255b-3bb4-4880-bb75-655fc8e6ac79 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:17.337756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1277/2572] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:37:17 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:37:17.339006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3794d-a423-493d-a8fa-56171b5d0e04 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:17.350604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3794d-a423-493d-a8fa-56171b5d0e04 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:17.355127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d90ae-866f-446d-b978-77cb4c6180d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:17.355880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d90ae-866f-446d-b978-77cb4c6180d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:17.356165 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d90ae-866f-446d-b978-77cb4c6180d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:17.356432 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d90ae-866f-446d-b978-77cb4c6180d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.357341 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d90ae-866f-446d-b978-77cb4c6180d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:17.358866 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d90ae-866f-446d-b978-77cb4c6180d5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:17.375032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1296/2573] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:37:17.376142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267255b-3bb4-4880-bb75-655fc8e6ac79 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:17.387305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267255b-3bb4-4880-bb75-655fc8e6ac79 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:17.392577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc366f5-d0af-4d4e-801e-5320c6320088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:17.393622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc366f5-d0af-4d4e-801e-5320c6320088 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:17.393622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc366f5-d0af-4d4e-801e-5320c6320088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:17.393853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc366f5-d0af-4d4e-801e-5320c6320088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.394573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc366f5-d0af-4d4e-801e-5320c6320088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:17.396192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc366f5-d0af-4d4e-801e-5320c6320088 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:17.407297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1278/2574] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:37:17.411936 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d90ae-866f-446d-b978-77cb4c6180d5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:17.422350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d90ae-866f-446d-b978-77cb4c6180d5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:17.426880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0633ce-88ca-419f-8121-79c34757d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:17.427781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0633ce-88ca-419f-8121-79c34757d1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:17.428059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0633ce-88ca-419f-8121-79c34757d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:17.428325 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0633ce-88ca-419f-8121-79c34757d1bc admin admin] PATH_INFO: `/v3/projects/082c54e72c84406f9de4f39c9cd2cf53/users/b68a42cadeb64ec49ca04d05cbb48d70/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.444651 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0633ce-88ca-419f-8121-79c34757d1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=082c54e72c84406f9de4f39c9cd2cf53, user_id=b68a42cadeb64ec49ca04d05cbb48d70, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:17.447543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0633ce-88ca-419f-8121-79c34757d1bc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:17.462858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1297/2575] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:37:17 2022] PUT /identity/v3/projects/082c54e72c84406f9de4f39c9cd2cf53/users/b68a42cadeb64ec49ca04d05cbb48d70/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:17.474989 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9160a52-79bf-484f-aaf0-3f69dffc38c3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:17.475287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9160a52-79bf-484f-aaf0-3f69dffc38c3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:17.475569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9160a52-79bf-484f-aaf0-3f69dffc38c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.503140 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d9160a52-79bf-484f-aaf0-3f69dffc38c3 None None] MFA Rules not processed for user `b68a42cadeb64ec49ca04d05cbb48d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:17.504361 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d9160a52-79bf-484f-aaf0-3f69dffc38c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:17.567817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1279/2576] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:17.579570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0633ce-88ca-419f-8121-79c34757d1bc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:17.581599 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8b0633ce-88ca-419f-8121-79c34757d1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:17.595928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:17.645122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0633ce-88ca-419f-8121-79c34757d1bc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:17.649328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2e3f9-c087-45aa-bd93-fd9a567dee9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:17.649979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2e3f9-c087-45aa-bd93-fd9a567dee9b service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:17.650256 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2e3f9-c087-45aa-bd93-fd9a567dee9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:17.650535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2e3f9-c087-45aa-bd93-fd9a567dee9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.659103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2e3f9-c087-45aa-bd93-fd9a567dee9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:17.660543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2e3f9-c087-45aa-bd93-fd9a567dee9b service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:17.669645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1298/2577] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:17.736099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31aa0d-5275-4d6b-a260-5955b537240d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:17.736594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31aa0d-5275-4d6b-a260-5955b537240d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:17.736995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31aa0d-5275-4d6b-a260-5955b537240d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.758353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7b31aa0d-5275-4d6b-a260-5955b537240d None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:17.759631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7b31aa0d-5275-4d6b-a260-5955b537240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:17.775792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:17.842126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1280/2578] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jul 6 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:17.855762 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2e3f9-c087-45aa-bd93-fd9a567dee9b service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:17.857218 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d3e2e3f9-c087-45aa-bd93-fd9a567dee9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:17.925173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2e3f9-c087-45aa-bd93-fd9a567dee9b service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:17.931028 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81be4f-227b-4ff8-b110-e9fd670f7d28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:17.931758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81be4f-227b-4ff8-b110-e9fd670f7d28 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:17.932036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81be4f-227b-4ff8-b110-e9fd670f7d28 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:17.932348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81be4f-227b-4ff8-b110-e9fd670f7d28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:17.944016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81be4f-227b-4ff8-b110-e9fd670f7d28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:17.946578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81be4f-227b-4ff8-b110-e9fd670f7d28 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:17.955351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1299/2579] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:37:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:37:20.213191 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31aa0d-5275-4d6b-a260-5955b537240d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:20.214724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7b31aa0d-5275-4d6b-a260-5955b537240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:20.275538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31aa0d-5275-4d6b-a260-5955b537240d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:20.280124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735d008-15e8-4987-9de3-cb9bd34c63d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:20.280790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d008-15e8-4987-9de3-cb9bd34c63d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:20.281145 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d008-15e8-4987-9de3-cb9bd34c63d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:20.281426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d008-15e8-4987-9de3-cb9bd34c63d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:20.283531 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5735d008-15e8-4987-9de3-cb9bd34c63d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:20.356934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735d008-15e8-4987-9de3-cb9bd34c63d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:20.359609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735d008-15e8-4987-9de3-cb9bd34c63d7 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:20.370173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1281/2580] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:25.882275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81be4f-227b-4ff8-b110-e9fd670f7d28 service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:26.016332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81be4f-227b-4ff8-b110-e9fd670f7d28 service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:26.040192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad328738-d063-487f-ba7e-21716583b2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:26.055458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad328738-d063-487f-ba7e-21716583b2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:26.058371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad328738-d063-487f-ba7e-21716583b2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:26.058670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad328738-d063-487f-ba7e-21716583b2a9 admin admin] PATH_INFO: `/v3/users/b68a42cadeb64ec49ca04d05cbb48d70` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:26.060127 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad328738-d063-487f-ba7e-21716583b2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68a42cadeb64ec49ca04d05cbb48d70)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:26.062902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad328738-d063-487f-ba7e-21716583b2a9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:26.120455 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735d008-15e8-4987-9de3-cb9bd34c63d7 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:26.122014 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5735d008-15e8-4987-9de3-cb9bd34c63d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:26.141933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735d008-15e8-4987-9de3-cb9bd34c63d7 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:26.147235 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:26.150202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:26.150514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ad328738-d063-487f-ba7e-21716583b2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68a42cadeb64ec49ca04d05cbb48d70'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.151103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:26.151549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:26.152039 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] PATH_INFO: `/v3/users/379b9d83fdc741ba92fa198a3bc5f108` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:26.153456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=379b9d83fdc741ba92fa198a3bc5f108)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:26.155526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:26.176112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ad328738-d063-487f-ba7e-21716583b2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68a42cadeb64ec49ca04d05cbb48d70'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.177453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ad328738-d063-487f-ba7e-21716583b2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68a42cadeb64ec49ca04d05cbb48d70'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.189347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ad328738-d063-487f-ba7e-21716583b2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68a42cadeb64ec49ca04d05cbb48d70'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.201548 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ad328738-d063-487f-ba7e-21716583b2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68a42cadeb64ec49ca04d05cbb48d70'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.208207 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1300/2581] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:37:25 2022] DELETE /identity/v3/users/b68a42cadeb64ec49ca04d05cbb48d70 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:26.212516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64423e3-c31b-41e7-a272-39bcaba98939 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:26.213030 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64423e3-c31b-41e7-a272-39bcaba98939 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:26.213379 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64423e3-c31b-41e7-a272-39bcaba98939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:26.214188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379b9d83fdc741ba92fa198a3bc5f108'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.230841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379b9d83fdc741ba92fa198a3bc5f108'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.231555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379b9d83fdc741ba92fa198a3bc5f108'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.232424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c64423e3-c31b-41e7-a272-39bcaba98939 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:26.232698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379b9d83fdc741ba92fa198a3bc5f108'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.233773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c64423e3-c31b-41e7-a272-39bcaba98939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:26.235512 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:26.241815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379b9d83fdc741ba92fa198a3bc5f108'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.255587 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1282/2582] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:37:26 2022] DELETE /identity/v3/users/379b9d83fdc741ba92fa198a3bc5f108 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:26.296506 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1301/2583] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:37:26.306543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:26.307915 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:26.375173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b8832-0803-44cd-b05c-98a23915a8ec admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:26.382657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f162b68-ea2a-4b3e-8e77-b0cb65a644dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:26.383449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f162b68-ea2a-4b3e-8e77-b0cb65a644dd service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:26.383733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f162b68-ea2a-4b3e-8e77-b0cb65a644dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:26.384004 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f162b68-ea2a-4b3e-8e77-b0cb65a644dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:26.455580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f162b68-ea2a-4b3e-8e77-b0cb65a644dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:26.457368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f162b68-ea2a-4b3e-8e77-b0cb65a644dd service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:26.459036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64423e3-c31b-41e7-a272-39bcaba98939 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:26.460693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c64423e3-c31b-41e7-a272-39bcaba98939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:26.468766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1283/2584] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:26.474848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64423e3-c31b-41e7-a272-39bcaba98939 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:26.481659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:26.483191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:26.483524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:26.483748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] PATH_INFO: `/v3/projects/0eb9b809ea014f6aa73d8daa9c4e1e6d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:26.485632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb9b809ea014f6aa73d8daa9c4e1e6d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:26.488366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:26.558163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb9b809ea014f6aa73d8daa9c4e1e6d', 'request_id': 'req-c8d1646c-1892-4fae-8a02-f444ab219353'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.569231 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb9b809ea014f6aa73d8daa9c4e1e6d', 'request_id': 'req-c8d1646c-1892-4fae-8a02-f444ab219353'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.577565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb9b809ea014f6aa73d8daa9c4e1e6d', 'request_id': 'req-c8d1646c-1892-4fae-8a02-f444ab219353'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.596058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] The token cache is being invalidate because project 0eb9b809ea014f6aa73d8daa9c4e1e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:37:26.596689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.597397 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.598956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1302/2585] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:37:26 2022] DELETE /identity/v3/projects/0eb9b809ea014f6aa73d8daa9c4e1e6d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:26.602997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f162b68-ea2a-4b3e-8e77-b0cb65a644dd service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:26.614217 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f162b68-ea2a-4b3e-8e77-b0cb65a644dd service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:26.686173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:26.687504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:26.687504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:26.687914 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] PATH_INFO: `/v3/users/427647e667cb4434a334d21d084fe3e5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:26.689504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=427647e667cb4434a334d21d084fe3e5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:26.692482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:26.741081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:26.757797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427647e667cb4434a334d21d084fe3e5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.767236 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:26.768757 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:26.782215 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427647e667cb4434a334d21d084fe3e5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.782879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427647e667cb4434a334d21d084fe3e5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.783552 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427647e667cb4434a334d21d084fe3e5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.792527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427647e667cb4434a334d21d084fe3e5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.801232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1646c-1892-4fae-8a02-f444ab219353 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:26.806442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:26.807841 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:26.808499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:26.808889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] PATH_INFO: `/v3/projects/082c54e72c84406f9de4f39c9cd2cf53` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:26.810339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=082c54e72c84406f9de4f39c9cd2cf53)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:26.813234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:26.815738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1284/2586] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:37:26 2022] DELETE /identity/v3/users/427647e667cb4434a334d21d084fe3e5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:26.872515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:26.882068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082c54e72c84406f9de4f39c9cd2cf53', 'request_id': 'req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.893279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082c54e72c84406f9de4f39c9cd2cf53', 'request_id': 'req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.904876 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082c54e72c84406f9de4f39c9cd2cf53', 'request_id': 'req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.920003 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] The token cache is being invalidate because project 082c54e72c84406f9de4f39c9cd2cf53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:37:26.920632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.921334 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:26.923341 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1303/2587] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:37:26 2022] DELETE /identity/v3/projects/082c54e72c84406f9de4f39c9cd2cf53 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:37:27.054727 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:27.056221 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:27.132331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a953f-2855-4482-90cf-2e13caf973ce admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:27.197420 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:27.198316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:27.198661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:27.198937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] PATH_INFO: `/v3/projects/fee7daf53f754373aa4b3583f389d19c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:27.200182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee7daf53f754373aa4b3583f389d19c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:27.202300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:27.255300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee7daf53f754373aa4b3583f389d19c', 'request_id': 'req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:27.262527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee7daf53f754373aa4b3583f389d19c', 'request_id': 'req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:27.267288 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:27.268409 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee7daf53f754373aa4b3583f389d19c', 'request_id': 'req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:27.282269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] The token cache is being invalidate because project fee7daf53f754373aa4b3583f389d19c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:37:27.282696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:27.283366 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:27.285123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1285/2588] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:37:27 2022] DELETE /identity/v3/projects/fee7daf53f754373aa4b3583f389d19c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:36.915027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=9,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:37.284254 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:46.818460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:46.819958 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:46.890054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4646d-ff4a-4b54-bcb2-234b09e922f8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:46.939857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e6cc6-fedf-4bc5-84a3-0bc234cb23bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:46.940669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6cc6-fedf-4bc5-84a3-0bc234cb23bf service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:46.940972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6cc6-fedf-4bc5-84a3-0bc234cb23bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:46.941283 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6cc6-fedf-4bc5-84a3-0bc234cb23bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:46.943410 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-198e6cc6-fedf-4bc5-84a3-0bc234cb23bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:47.012078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e6cc6-fedf-4bc5-84a3-0bc234cb23bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:47.014224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e6cc6-fedf-4bc5-84a3-0bc234cb23bf service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:47.029978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1304/2589] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:50.248798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:50.250440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:50.265489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9138d4-bbdf-4e9d-8da5-63970fc4e9eb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:50.270432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd333d66-911f-4913-ab47-d6f77a0c35a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:50.271536 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd333d66-911f-4913-ab47-d6f77a0c35a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:50.271842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd333d66-911f-4913-ab47-d6f77a0c35a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:50.272131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd333d66-911f-4913-ab47-d6f77a0c35a1 admin admin] PATH_INFO: `/v3/users/eca463f83a0d4677b1c10d388ab60419` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:50.273392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd333d66-911f-4913-ab47-d6f77a0c35a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eca463f83a0d4677b1c10d388ab60419)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:50.275340 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd333d66-911f-4913-ab47-d6f77a0c35a1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:50.323825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd333d66-911f-4913-ab47-d6f77a0c35a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eca463f83a0d4677b1c10d388ab60419'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:50.336034 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd333d66-911f-4913-ab47-d6f77a0c35a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eca463f83a0d4677b1c10d388ab60419'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:50.336707 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd333d66-911f-4913-ab47-d6f77a0c35a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eca463f83a0d4677b1c10d388ab60419'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:50.337349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd333d66-911f-4913-ab47-d6f77a0c35a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eca463f83a0d4677b1c10d388ab60419'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:50.346353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd333d66-911f-4913-ab47-d6f77a0c35a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eca463f83a0d4677b1c10d388ab60419'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:50.359889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1286/2590] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:37:50 2022] DELETE /identity/v3/users/eca463f83a0d4677b1c10d388ab60419 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:50.539401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e6cc6-fedf-4bc5-84a3-0bc234cb23bf service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:50.551015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e6cc6-fedf-4bc5-84a3-0bc234cb23bf service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:50.610200 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:50.610999 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:50.611279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:50.611552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] PATH_INFO: `/v3/projects/0c6bac2fbc3342c7a8c5f9f64d0d44ea` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:50.612809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6bac2fbc3342c7a8c5f9f64d0d44ea)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:50.614809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:50.623226 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:50.668258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6bac2fbc3342c7a8c5f9f64d0d44ea', 'request_id': 'req-1131f965-eb52-4922-85e3-67ab385ab593'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:50.675677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6bac2fbc3342c7a8c5f9f64d0d44ea', 'request_id': 'req-1131f965-eb52-4922-85e3-67ab385ab593'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:50.681338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6bac2fbc3342c7a8c5f9f64d0d44ea', 'request_id': 'req-1131f965-eb52-4922-85e3-67ab385ab593'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:50.692930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] The token cache is being invalidate because project 0c6bac2fbc3342c7a8c5f9f64d0d44ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:37:50.693249 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:50.693929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1131f965-eb52-4922-85e3-67ab385ab593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:50.695484 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1305/2591] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:37:50 2022] DELETE /identity/v3/projects/0c6bac2fbc3342c7a8c5f9f64d0d44ea => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:50.700854 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8bef3-8cab-4108-9c4b-520181e09cf2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:50.701173 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8bef3-8cab-4108-9c4b-520181e09cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:50.701474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8bef3-8cab-4108-9c4b-520181e09cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:50.721105 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f7d8bef3-8cab-4108-9c4b-520181e09cf2 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:50.722331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f7d8bef3-8cab-4108-9c4b-520181e09cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:50.784493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1287/2592] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:50.792794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0018f-3374-4899-ad71-6e35193955a1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:50.793113 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0018f-3374-4899-ad71-6e35193955a1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:50.793388 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0018f-3374-4899-ad71-6e35193955a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:50.812690 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-28c0018f-3374-4899-ad71-6e35193955a1 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:50.813963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-28c0018f-3374-4899-ad71-6e35193955a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:50.823912 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1306/2593] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:50.828235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8bef3-8cab-4108-9c4b-520181e09cf2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:50.838416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8bef3-8cab-4108-9c4b-520181e09cf2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:50.843575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f243310-dce0-4c51-b127-9ea1f4a21ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:50.844239 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243310-dce0-4c51-b127-9ea1f4a21ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:50.844523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243310-dce0-4c51-b127-9ea1f4a21ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:50.845172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243310-dce0-4c51-b127-9ea1f4a21ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:50.845937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f243310-dce0-4c51-b127-9ea1f4a21ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:37:50.846240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f243310-dce0-4c51-b127-9ea1f4a21ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:50.847844 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f243310-dce0-4c51-b127-9ea1f4a21ed6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:50.860522 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1288/2594] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:37:50.864853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0018f-3374-4899-ad71-6e35193955a1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:50.874254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0018f-3374-4899-ad71-6e35193955a1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:50.879057 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2e4cf-6d4b-42f0-ae9d-87937af63e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:50.879698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2e4cf-6d4b-42f0-ae9d-87937af63e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:50.879962 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2e4cf-6d4b-42f0-ae9d-87937af63e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:50.880235 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2e4cf-6d4b-42f0-ae9d-87937af63e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:50.881275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2e4cf-6d4b-42f0-ae9d-87937af63e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:50.884308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2e4cf-6d4b-42f0-ae9d-87937af63e9d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:50.915222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1307/2595] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:37:50 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:37:50.919442 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f243310-dce0-4c51-b127-9ea1f4a21ed6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:50.929933 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f243310-dce0-4c51-b127-9ea1f4a21ed6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:50.988345 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99ab6-1521-4ff1-99d7-ed806ace866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:50.989051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99ab6-1521-4ff1-99d7-ed806ace866f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:50.989336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99ab6-1521-4ff1-99d7-ed806ace866f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:50.989608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99ab6-1521-4ff1-99d7-ed806ace866f admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:50.990356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea99ab6-1521-4ff1-99d7-ed806ace866f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:50.992357 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea99ab6-1521-4ff1-99d7-ed806ace866f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:50.999030 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:51.015724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1289/2596] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:37:50 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:37:51.019912 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2e4cf-6d4b-42f0-ae9d-87937af63e9d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:51.030823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2e4cf-6d4b-42f0-ae9d-87937af63e9d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:51.035455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf9484-2b85-44a6-b81d-a90b6f8cb37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:51.036110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf9484-2b85-44a6-b81d-a90b6f8cb37b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.036385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf9484-2b85-44a6-b81d-a90b6f8cb37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.036679 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf9484-2b85-44a6-b81d-a90b6f8cb37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.037437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf9484-2b85-44a6-b81d-a90b6f8cb37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:51.039018 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf9484-2b85-44a6-b81d-a90b6f8cb37b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:51.049623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1308/2597] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:37:51.053760 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99ab6-1521-4ff1-99d7-ed806ace866f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:51.064582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99ab6-1521-4ff1-99d7-ed806ace866f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:51.069927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86c23e-4de5-43aa-8a99-eb4bd359951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:51.070598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c23e-4de5-43aa-8a99-eb4bd359951a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.070880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c23e-4de5-43aa-8a99-eb4bd359951a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.071156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c23e-4de5-43aa-8a99-eb4bd359951a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.071900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86c23e-4de5-43aa-8a99-eb4bd359951a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:51.073592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86c23e-4de5-43aa-8a99-eb4bd359951a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:51.084070 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1290/2598] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:37:51.088365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf9484-2b85-44a6-b81d-a90b6f8cb37b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:51.098885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf9484-2b85-44a6-b81d-a90b6f8cb37b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:51.103839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721e775-5823-43a0-9d9c-b43234846d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:51.104713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721e775-5823-43a0-9d9c-b43234846d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.104985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721e775-5823-43a0-9d9c-b43234846d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.105315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721e775-5823-43a0-9d9c-b43234846d54 admin admin] PATH_INFO: `/v3/projects/c389e5f147dc462384eb95694be8a785/users/0584240fae0b464bb21f66417845297c/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.120786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721e775-5823-43a0-9d9c-b43234846d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c389e5f147dc462384eb95694be8a785, user_id=0584240fae0b464bb21f66417845297c, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:51.123418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721e775-5823-43a0-9d9c-b43234846d54 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:51.143017 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1309/2599] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:37:51 2022] PUT /identity/v3/projects/c389e5f147dc462384eb95694be8a785/users/0584240fae0b464bb21f66417845297c/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:37:51.154402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f67e5-4c77-4fb0-860f-13b98d7f1fb2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.154689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f67e5-4c77-4fb0-860f-13b98d7f1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.154962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f67e5-4c77-4fb0-860f-13b98d7f1fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.184541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-433f67e5-4c77-4fb0-860f-13b98d7f1fb2 None None] MFA Rules not processed for user `0584240fae0b464bb21f66417845297c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:51.185793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-433f67e5-4c77-4fb0-860f-13b98d7f1fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:51.251242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1291/2600] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:51.256005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721e775-5823-43a0-9d9c-b43234846d54 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:51.321570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721e775-5823-43a0-9d9c-b43234846d54 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:51.326103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6b5c2-5379-4c03-b4f8-3c0791a49300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:51.326766 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6b5c2-5379-4c03-b4f8-3c0791a49300 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.327045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6b5c2-5379-4c03-b4f8-3c0791a49300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.327319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6b5c2-5379-4c03-b4f8-3c0791a49300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.328014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6b5c2-5379-4c03-b4f8-3c0791a49300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:51.330033 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6b5c2-5379-4c03-b4f8-3c0791a49300 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:51.361780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1310/2601] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:37:51 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:37:51.366046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f67e5-4c77-4fb0-860f-13b98d7f1fb2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:51.379016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f67e5-4c77-4fb0-860f-13b98d7f1fb2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:51.438653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcddcc-7c03-4ad9-9bec-2a2fc4d56457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:51.439329 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcddcc-7c03-4ad9-9bec-2a2fc4d56457 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.439607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcddcc-7c03-4ad9-9bec-2a2fc4d56457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.439876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcddcc-7c03-4ad9-9bec-2a2fc4d56457 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.440580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcddcc-7c03-4ad9-9bec-2a2fc4d56457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:51.442538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcddcc-7c03-4ad9-9bec-2a2fc4d56457 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:51.464149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1292/2602] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:37:51 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:37:51.469570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6b5c2-5379-4c03-b4f8-3c0791a49300 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:51.480528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6b5c2-5379-4c03-b4f8-3c0791a49300 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:51.485317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65556f-3b7d-490a-b54a-5dca3bf58078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:51.485982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65556f-3b7d-490a-b54a-5dca3bf58078 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.486262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65556f-3b7d-490a-b54a-5dca3bf58078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.486563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65556f-3b7d-490a-b54a-5dca3bf58078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.487303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65556f-3b7d-490a-b54a-5dca3bf58078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:51.488916 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65556f-3b7d-490a-b54a-5dca3bf58078 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:51.499591 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1311/2603] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:37:51.503718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcddcc-7c03-4ad9-9bec-2a2fc4d56457 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:51.513740 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcddcc-7c03-4ad9-9bec-2a2fc4d56457 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:51.518780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef7009-d6ef-47b9-8570-369e65f25a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:51.519661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef7009-d6ef-47b9-8570-369e65f25a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.519937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef7009-d6ef-47b9-8570-369e65f25a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.520209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef7009-d6ef-47b9-8570-369e65f25a4b admin admin] PATH_INFO: `/v3/projects/00938385e8a0479ca5b5b7ae9c346a7e/users/14deb717ccff4fd0ba1883bf0a3a99a5/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.535446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef7009-d6ef-47b9-8570-369e65f25a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00938385e8a0479ca5b5b7ae9c346a7e, user_id=14deb717ccff4fd0ba1883bf0a3a99a5, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:51.538170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef7009-d6ef-47b9-8570-369e65f25a4b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:51.553503 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1293/2604] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:37:51 2022] PUT /identity/v3/projects/00938385e8a0479ca5b5b7ae9c346a7e/users/14deb717ccff4fd0ba1883bf0a3a99a5/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:51.557704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65556f-3b7d-490a-b54a-5dca3bf58078 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:51.568391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65556f-3b7d-490a-b54a-5dca3bf58078 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:51.572316 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:51.627596 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc45f94-3f93-4487-b4e3-beabe7c98d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:51.628258 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc45f94-3f93-4487-b4e3-beabe7c98d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.628536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc45f94-3f93-4487-b4e3-beabe7c98d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.628807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc45f94-3f93-4487-b4e3-beabe7c98d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.629626 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc45f94-3f93-4487-b4e3-beabe7c98d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:51.631208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc45f94-3f93-4487-b4e3-beabe7c98d4f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:51.640929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1312/2605] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:37:51.645416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef7009-d6ef-47b9-8570-369e65f25a4b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:51.656087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef7009-d6ef-47b9-8570-369e65f25a4b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:51.660917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab627e-50ec-4579-bbb0-b44f2ac9992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:51.661921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab627e-50ec-4579-bbb0-b44f2ac9992a admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.662178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab627e-50ec-4579-bbb0-b44f2ac9992a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.662452 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab627e-50ec-4579-bbb0-b44f2ac9992a admin admin] PATH_INFO: `/v3/projects/00938385e8a0479ca5b5b7ae9c346a7e/users/14deb717ccff4fd0ba1883bf0a3a99a5/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.664419 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab627e-50ec-4579-bbb0-b44f2ac9992a admin admin] RBAC: Authorizing `identity:create_grant(project_id=00938385e8a0479ca5b5b7ae9c346a7e, user_id=14deb717ccff4fd0ba1883bf0a3a99a5, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:51.667082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab627e-50ec-4579-bbb0-b44f2ac9992a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:51.677810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1294/2606] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:37:51 2022] PUT /identity/v3/projects/00938385e8a0479ca5b5b7ae9c346a7e/users/14deb717ccff4fd0ba1883bf0a3a99a5/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:51.689465 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b0d8f-791e-438b-abe5-ac45b17ab810 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.689754 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b0d8f-791e-438b-abe5-ac45b17ab810 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.690031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b0d8f-791e-438b-abe5-ac45b17ab810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.717564 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-142b0d8f-791e-438b-abe5-ac45b17ab810 None None] MFA Rules not processed for user `14deb717ccff4fd0ba1883bf0a3a99a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:51.720872 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-142b0d8f-791e-438b-abe5-ac45b17ab810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:51.802646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1313/2607] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:51 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:51.813827 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab627e-50ec-4579-bbb0-b44f2ac9992a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:51.815815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-abab627e-50ec-4579-bbb0-b44f2ac9992a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:51.838872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:51.882283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab627e-50ec-4579-bbb0-b44f2ac9992a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:51.888802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd580cdb-8e95-425c-a53a-9303bd92e18d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:51.889779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580cdb-8e95-425c-a53a-9303bd92e18d service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:51.890123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580cdb-8e95-425c-a53a-9303bd92e18d service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:51.890411 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580cdb-8e95-425c-a53a-9303bd92e18d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:51.903087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd580cdb-8e95-425c-a53a-9303bd92e18d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:51.904525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd580cdb-8e95-425c-a53a-9303bd92e18d service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:51.917181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1295/2608] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:51 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:52.051768 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b0d8f-791e-438b-abe5-ac45b17ab810 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:52.121229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b0d8f-791e-438b-abe5-ac45b17ab810 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:52.126033 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:52.126924 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:52.127203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:52.127480 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] PATH_INFO: `/v3/users/0584240fae0b464bb21f66417845297c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:52.128742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0584240fae0b464bb21f66417845297c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:52.130804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:52.166758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:52.181321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0584240fae0b464bb21f66417845297c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.193628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0584240fae0b464bb21f66417845297c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.194346 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0584240fae0b464bb21f66417845297c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.202694 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0584240fae0b464bb21f66417845297c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.209699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0584240fae0b464bb21f66417845297c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.215649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1314/2609] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:37:52 2022] DELETE /identity/v3/users/0584240fae0b464bb21f66417845297c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:52.220608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eacd8a-0494-4377-9977-f2a4b4d08ebb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:52.221019 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eacd8a-0494-4377-9977-f2a4b4d08ebb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:52.221299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eacd8a-0494-4377-9977-f2a4b4d08ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:52.239628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-51eacd8a-0494-4377-9977-f2a4b4d08ebb None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:52.240820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-51eacd8a-0494-4377-9977-f2a4b4d08ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:52.305865 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1296/2610] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:52.318811 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:52.320352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:52.380278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290100f-987d-454d-8752-c9795a8a1d79 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:52.384333 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2153319-7bd1-468d-8c59-32f19e38021f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:52.384988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2153319-7bd1-468d-8c59-32f19e38021f service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:52.385309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2153319-7bd1-468d-8c59-32f19e38021f service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:52.385586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2153319-7bd1-468d-8c59-32f19e38021f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:52.394896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2153319-7bd1-468d-8c59-32f19e38021f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:52.396414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2153319-7bd1-468d-8c59-32f19e38021f service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:52.406116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1315/2611] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:52.688658 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eacd8a-0494-4377-9977-f2a4b4d08ebb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:52.690164 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-51eacd8a-0494-4377-9977-f2a4b4d08ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:52.701939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eacd8a-0494-4377-9977-f2a4b4d08ebb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:52.706718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:52.707619 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:52.707893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:52.708160 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] PATH_INFO: `/v3/projects/c389e5f147dc462384eb95694be8a785` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:52.709544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c389e5f147dc462384eb95694be8a785)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:52.711433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:52.760926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c389e5f147dc462384eb95694be8a785', 'request_id': 'req-643d6827-9989-4578-bfbd-00704ad3e800'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.770216 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c389e5f147dc462384eb95694be8a785', 'request_id': 'req-643d6827-9989-4578-bfbd-00704ad3e800'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.776707 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c389e5f147dc462384eb95694be8a785', 'request_id': 'req-643d6827-9989-4578-bfbd-00704ad3e800'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.789216 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] The token cache is being invalidate because project c389e5f147dc462384eb95694be8a785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:37:52.789474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.790223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.791881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1297/2612] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:37:52 2022] DELETE /identity/v3/projects/c389e5f147dc462384eb95694be8a785 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:52.795945 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2153319-7bd1-468d-8c59-32f19e38021f service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:52.806111 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2153319-7bd1-468d-8c59-32f19e38021f service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:52.866328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a79f95-20ab-4fd7-85c4-ecbb6ec23c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:52.867211 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a79f95-20ab-4fd7-85c4-ecbb6ec23c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:52.867497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a79f95-20ab-4fd7-85c4-ecbb6ec23c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:52.867769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a79f95-20ab-4fd7-85c4-ecbb6ec23c81 admin admin] PATH_INFO: `/v3/users/14deb717ccff4fd0ba1883bf0a3a99a5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:52.869009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a79f95-20ab-4fd7-85c4-ecbb6ec23c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14deb717ccff4fd0ba1883bf0a3a99a5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:52.870989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a79f95-20ab-4fd7-85c4-ecbb6ec23c81 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:52.931787 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1a79f95-20ab-4fd7-85c4-ecbb6ec23c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14deb717ccff4fd0ba1883bf0a3a99a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.938910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:52.949655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1a79f95-20ab-4fd7-85c4-ecbb6ec23c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14deb717ccff4fd0ba1883bf0a3a99a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.950516 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1a79f95-20ab-4fd7-85c4-ecbb6ec23c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14deb717ccff4fd0ba1883bf0a3a99a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.960123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1a79f95-20ab-4fd7-85c4-ecbb6ec23c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14deb717ccff4fd0ba1883bf0a3a99a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.967424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1a79f95-20ab-4fd7-85c4-ecbb6ec23c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14deb717ccff4fd0ba1883bf0a3a99a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:52.974089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1316/2613] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:37:52 2022] DELETE /identity/v3/users/14deb717ccff4fd0ba1883bf0a3a99a5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:53.246799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:53.250092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:53.263872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d6827-9989-4578-bfbd-00704ad3e800 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:53.309061 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:53.326051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:53.326938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:53.327214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:53.327484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] PATH_INFO: `/v3/projects/00938385e8a0479ca5b5b7ae9c346a7e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:53.328686 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00938385e8a0479ca5b5b7ae9c346a7e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:53.330618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:53.381250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00938385e8a0479ca5b5b7ae9c346a7e', 'request_id': 'req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:53.390525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00938385e8a0479ca5b5b7ae9c346a7e', 'request_id': 'req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:53.396039 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00938385e8a0479ca5b5b7ae9c346a7e', 'request_id': 'req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:53.406910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] The token cache is being invalidate because project 00938385e8a0479ca5b5b7ae9c346a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:37:53.407195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:53.407810 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-193654ae-a8c9-4dc3-b4be-3548d8a7b1e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:53.409443 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1298/2614] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:37:53 2022] DELETE /identity/v3/projects/00938385e8a0479ca5b5b7ae9c346a7e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:53.414627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7668bf-e605-43ac-ac9c-0197b61744e6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:53.414915 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7668bf-e605-43ac-ac9c-0197b61744e6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:53.415189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7668bf-e605-43ac-ac9c-0197b61744e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:53.432869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ce7668bf-e605-43ac-ac9c-0197b61744e6 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:53.434083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ce7668bf-e605-43ac-ac9c-0197b61744e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:53.494208 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1317/2615] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:37:53.502181 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f252f-1b19-4c1a-a8b7-f6338276978d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:53.502513 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f252f-1b19-4c1a-a8b7-f6338276978d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:53.502763 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f252f-1b19-4c1a-a8b7-f6338276978d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:53.523104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1c5f252f-1b19-4c1a-a8b7-f6338276978d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:53.524302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1c5f252f-1b19-4c1a-a8b7-f6338276978d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:53.532382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1299/2616] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:53.536720 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7668bf-e605-43ac-ac9c-0197b61744e6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:53.546788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7668bf-e605-43ac-ac9c-0197b61744e6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:53.551508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e099719-e755-4e1b-b8c1-065bd5c26698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:53.552237 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e099719-e755-4e1b-b8c1-065bd5c26698 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:53.552519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e099719-e755-4e1b-b8c1-065bd5c26698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:53.552797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e099719-e755-4e1b-b8c1-065bd5c26698 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:53.553607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e099719-e755-4e1b-b8c1-065bd5c26698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:37:53.553922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e099719-e755-4e1b-b8c1-065bd5c26698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:53.555514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e099719-e755-4e1b-b8c1-065bd5c26698 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:53.567350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1318/2617] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:37:53.571743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f252f-1b19-4c1a-a8b7-f6338276978d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:53.581524 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f252f-1b19-4c1a-a8b7-f6338276978d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:53.587104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2f11e-94b2-4aa7-af8d-2c589fe07f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:53.587761 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2f11e-94b2-4aa7-af8d-2c589fe07f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:53.588041 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2f11e-94b2-4aa7-af8d-2c589fe07f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:53.588312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2f11e-94b2-4aa7-af8d-2c589fe07f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:53.589042 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2f11e-94b2-4aa7-af8d-2c589fe07f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:53.590953 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2f11e-94b2-4aa7-af8d-2c589fe07f19 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:53.620064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1300/2618] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:37:53 2022] POST /identity/v3/projects => generated 357 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:37:53.624334 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e099719-e755-4e1b-b8c1-065bd5c26698 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:53.635046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e099719-e755-4e1b-b8c1-065bd5c26698 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:53.694749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdf4d9-f251-4451-93ee-d9f9dbf287f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:53.695420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdf4d9-f251-4451-93ee-d9f9dbf287f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:53.695703 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdf4d9-f251-4451-93ee-d9f9dbf287f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:53.695984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdf4d9-f251-4451-93ee-d9f9dbf287f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:53.696687 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdf4d9-f251-4451-93ee-d9f9dbf287f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:53.698643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdf4d9-f251-4451-93ee-d9f9dbf287f8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:53.721752 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1319/2619] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:37:53 2022] POST /identity/v3/users => generated 279 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:37:53.726932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2f11e-94b2-4aa7-af8d-2c589fe07f19 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:53.739608 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2f11e-94b2-4aa7-af8d-2c589fe07f19 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:53.743577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8bd02-11cb-454f-8f97-77e8c7ab02b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:53.744302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8bd02-11cb-454f-8f97-77e8c7ab02b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:53.744526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8bd02-11cb-454f-8f97-77e8c7ab02b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:53.744801 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8bd02-11cb-454f-8f97-77e8c7ab02b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:53.745582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8bd02-11cb-454f-8f97-77e8c7ab02b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:53.747287 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8bd02-11cb-454f-8f97-77e8c7ab02b0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:53.757956 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1301/2620] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:37:53.762428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdf4d9-f251-4451-93ee-d9f9dbf287f8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:53.772491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdf4d9-f251-4451-93ee-d9f9dbf287f8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:53.777417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec33ae3-4a65-4534-92f2-f7fdc6531fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:53.778072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec33ae3-4a65-4534-92f2-f7fdc6531fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:53.778362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec33ae3-4a65-4534-92f2-f7fdc6531fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:53.778638 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec33ae3-4a65-4534-92f2-f7fdc6531fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:53.779358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec33ae3-4a65-4534-92f2-f7fdc6531fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:53.780942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec33ae3-4a65-4534-92f2-f7fdc6531fb1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:53.791160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1320/2621] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:37:53.795255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8bd02-11cb-454f-8f97-77e8c7ab02b0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:53.805842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8bd02-11cb-454f-8f97-77e8c7ab02b0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:53.811237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017f302-7171-4c70-b4c1-90e1db8bb829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:53.812129 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017f302-7171-4c70-b4c1-90e1db8bb829 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:53.812412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017f302-7171-4c70-b4c1-90e1db8bb829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:53.812673 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017f302-7171-4c70-b4c1-90e1db8bb829 admin admin] PATH_INFO: `/v3/projects/868f2878113d4ca386c4d345db6a9880/users/6bd8b82a61854e419a3d4e09126ce2c7/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:53.828779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017f302-7171-4c70-b4c1-90e1db8bb829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868f2878113d4ca386c4d345db6a9880, user_id=6bd8b82a61854e419a3d4e09126ce2c7, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:53.831065 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017f302-7171-4c70-b4c1-90e1db8bb829 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:53.847269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1302/2622] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:37:53 2022] PUT /identity/v3/projects/868f2878113d4ca386c4d345db6a9880/users/6bd8b82a61854e419a3d4e09126ce2c7/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:53.857956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e77fe-b61d-431a-8346-e69e01a2832c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:53.858466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e77fe-b61d-431a-8346-e69e01a2832c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:53.858563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e77fe-b61d-431a-8346-e69e01a2832c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:53.885328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f04e77fe-b61d-431a-8346-e69e01a2832c None None] MFA Rules not processed for user `6bd8b82a61854e419a3d4e09126ce2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:53.886528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f04e77fe-b61d-431a-8346-e69e01a2832c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:53.910693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:53.956153 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1321/2623] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:53.961091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017f302-7171-4c70-b4c1-90e1db8bb829 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:54.028154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017f302-7171-4c70-b4c1-90e1db8bb829 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:54.033180 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e17e-f670-4450-9123-2e58e499d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:54.033866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e17e-f670-4450-9123-2e58e499d5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:54.034149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e17e-f670-4450-9123-2e58e499d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:54.034428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e17e-f670-4450-9123-2e58e499d5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:54.035114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1e17e-f670-4450-9123-2e58e499d5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:54.037051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1e17e-f670-4450-9123-2e58e499d5f1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:54.057131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:54.065228 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1303/2624] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:37:53 2022] POST /identity/v3/projects => generated 355 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:37:54.068915 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e77fe-b61d-431a-8346-e69e01a2832c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:54.079499 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e77fe-b61d-431a-8346-e69e01a2832c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:54.142447 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a7388-409f-419c-9ba3-e8a371cec055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:54.143123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a7388-409f-419c-9ba3-e8a371cec055 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:54.143408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a7388-409f-419c-9ba3-e8a371cec055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:54.143682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a7388-409f-419c-9ba3-e8a371cec055 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:54.144384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a7388-409f-419c-9ba3-e8a371cec055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:54.146443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a7388-409f-419c-9ba3-e8a371cec055 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:54.175425 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1322/2625] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:37:54 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:37:54.179573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e17e-f670-4450-9123-2e58e499d5f1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:54.190067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e17e-f670-4450-9123-2e58e499d5f1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:54.194991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd94e1-5fc9-43ef-a5ee-37474eb529d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:54.195649 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd94e1-5fc9-43ef-a5ee-37474eb529d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:54.195920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd94e1-5fc9-43ef-a5ee-37474eb529d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:54.196187 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd94e1-5fc9-43ef-a5ee-37474eb529d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:54.196912 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd94e1-5fc9-43ef-a5ee-37474eb529d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:54.198527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd94e1-5fc9-43ef-a5ee-37474eb529d1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:54.209120 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1304/2626] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:37:54.213825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a7388-409f-419c-9ba3-e8a371cec055 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:54.230239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a7388-409f-419c-9ba3-e8a371cec055 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:54.237976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ebfe-a03a-4261-bb98-3273ce9ff203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:54.238868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ebfe-a03a-4261-bb98-3273ce9ff203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:54.239148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ebfe-a03a-4261-bb98-3273ce9ff203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:54.239422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ebfe-a03a-4261-bb98-3273ce9ff203 admin admin] PATH_INFO: `/v3/projects/0b7799a739324016a98066faa855e11a/users/31e78afdfabe4e5894c8e75653b9ba0e/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:54.259834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ebfe-a03a-4261-bb98-3273ce9ff203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7799a739324016a98066faa855e11a, user_id=31e78afdfabe4e5894c8e75653b9ba0e, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:54.262535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ebfe-a03a-4261-bb98-3273ce9ff203 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:54.282350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1323/2627] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:37:54 2022] PUT /identity/v3/projects/0b7799a739324016a98066faa855e11a/users/31e78afdfabe4e5894c8e75653b9ba0e/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:54.288596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd94e1-5fc9-43ef-a5ee-37474eb529d1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:54.304294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd94e1-5fc9-43ef-a5ee-37474eb529d1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:54.366097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451d60f-a4a6-4a46-8be3-44011b38cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:54.366902 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d60f-a4a6-4a46-8be3-44011b38cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:54.367062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d60f-a4a6-4a46-8be3-44011b38cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:54.367298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d60f-a4a6-4a46-8be3-44011b38cc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:54.368042 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451d60f-a4a6-4a46-8be3-44011b38cc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:54.369677 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451d60f-a4a6-4a46-8be3-44011b38cc9a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:54.379814 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1305/2628] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:37:54.386059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ebfe-a03a-4261-bb98-3273ce9ff203 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:54.397167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ebfe-a03a-4261-bb98-3273ce9ff203 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:54.401875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa2c4-7af5-4440-959a-47e14362a214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:54.402788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa2c4-7af5-4440-959a-47e14362a214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:54.403074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa2c4-7af5-4440-959a-47e14362a214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:54.403342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa2c4-7af5-4440-959a-47e14362a214 admin admin] PATH_INFO: `/v3/projects/0b7799a739324016a98066faa855e11a/users/31e78afdfabe4e5894c8e75653b9ba0e/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:54.405536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfa2c4-7af5-4440-959a-47e14362a214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7799a739324016a98066faa855e11a, user_id=31e78afdfabe4e5894c8e75653b9ba0e, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:54.408157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfa2c4-7af5-4440-959a-47e14362a214 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:54.418919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1324/2629] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:37:54 2022] PUT /identity/v3/projects/0b7799a739324016a98066faa855e11a/users/31e78afdfabe4e5894c8e75653b9ba0e/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:54.430458 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca219cf-b224-4d36-b865-1275f1b39c18 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:54.430749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca219cf-b224-4d36-b865-1275f1b39c18 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:54.431022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca219cf-b224-4d36-b865-1275f1b39c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:54.464788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5ca219cf-b224-4d36-b865-1275f1b39c18 None None] MFA Rules not processed for user `31e78afdfabe4e5894c8e75653b9ba0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:54.466449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5ca219cf-b224-4d36-b865-1275f1b39c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:54.539376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1306/2630] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:37:54 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:54.550869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa2c4-7af5-4440-959a-47e14362a214 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:54.552646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d0bfa2c4-7af5-4440-959a-47e14362a214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:54.615107 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa2c4-7af5-4440-959a-47e14362a214 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:54.619409 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ce79-528b-4b55-beb5-31788e21edab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:54.620063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ce79-528b-4b55-beb5-31788e21edab service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:54.620352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ce79-528b-4b55-beb5-31788e21edab service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:54.620651 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ce79-528b-4b55-beb5-31788e21edab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:54.629951 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491ce79-528b-4b55-beb5-31788e21edab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:54.631515 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491ce79-528b-4b55-beb5-31788e21edab service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:54.641203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1325/2631] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:54 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:54.716759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca219cf-b224-4d36-b865-1275f1b39c18 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:54.726956 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca219cf-b224-4d36-b865-1275f1b39c18 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:54.730689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295a777-11c1-47c4-a7ed-764c6ba685a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:54.731342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a777-11c1-47c4-a7ed-764c6ba685a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:54.731621 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a777-11c1-47c4-a7ed-764c6ba685a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:54.731894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a777-11c1-47c4-a7ed-764c6ba685a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:54.791344 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295a777-11c1-47c4-a7ed-764c6ba685a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:54.792718 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295a777-11c1-47c4-a7ed-764c6ba685a1 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:54.801611 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1307/2632] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:54 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:04.636909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:04.797557 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:05.322778 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ce79-528b-4b55-beb5-31788e21edab service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:05.324460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4491ce79-528b-4b55-beb5-31788e21edab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:05.390132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ce79-528b-4b55-beb5-31788e21edab service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:05.394879 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599d545-e3bc-4bc2-a365-29fa07011b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:05.395509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599d545-e3bc-4bc2-a365-29fa07011b9b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:05.395795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599d545-e3bc-4bc2-a365-29fa07011b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:05.396076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599d545-e3bc-4bc2-a365-29fa07011b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:05.398151 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6599d545-e3bc-4bc2-a365-29fa07011b9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:05.473629 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599d545-e3bc-4bc2-a365-29fa07011b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:05.475002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599d545-e3bc-4bc2-a365-29fa07011b9b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:05.484842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1326/2633] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:08.676753 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295a777-11c1-47c4-a7ed-764c6ba685a1 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:08.678872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4295a777-11c1-47c4-a7ed-764c6ba685a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:08.700314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295a777-11c1-47c4-a7ed-764c6ba685a1 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:08.705063 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0c57-d754-4582-b5a4-cfc75cfa4d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:08.705960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0c57-d754-4582-b5a4-cfc75cfa4d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:08.706235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0c57-d754-4582-b5a4-cfc75cfa4d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:08.706504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0c57-d754-4582-b5a4-cfc75cfa4d32 admin admin] PATH_INFO: `/v3/users/3c50cd073cfa45bc9dc52dc65bf7e945` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:08.707768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0c57-d754-4582-b5a4-cfc75cfa4d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c50cd073cfa45bc9dc52dc65bf7e945)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:08.709925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0c57-d754-4582-b5a4-cfc75cfa4d32 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:08.761026 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-00bf0c57-d754-4582-b5a4-cfc75cfa4d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c50cd073cfa45bc9dc52dc65bf7e945'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:08.775004 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-00bf0c57-d754-4582-b5a4-cfc75cfa4d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c50cd073cfa45bc9dc52dc65bf7e945'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:08.775675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-00bf0c57-d754-4582-b5a4-cfc75cfa4d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c50cd073cfa45bc9dc52dc65bf7e945'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:08.776362 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-00bf0c57-d754-4582-b5a4-cfc75cfa4d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c50cd073cfa45bc9dc52dc65bf7e945'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:08.783383 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-00bf0c57-d754-4582-b5a4-cfc75cfa4d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c50cd073cfa45bc9dc52dc65bf7e945'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:08.796078 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1308/2634] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:38:08 2022] DELETE /identity/v3/users/3c50cd073cfa45bc9dc52dc65bf7e945 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:08.987219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599d545-e3bc-4bc2-a365-29fa07011b9b service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:08.997650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599d545-e3bc-4bc2-a365-29fa07011b9b service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:09.060056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:09.060943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.061254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.061528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] PATH_INFO: `/v3/projects/8bd9a1e1ce0a4f4c92ba744aa3ce63f5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.062777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd9a1e1ce0a4f4c92ba744aa3ce63f5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:09.064698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:09.115670 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd9a1e1ce0a4f4c92ba744aa3ce63f5', 'request_id': 'req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:09.118072 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:09.124739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd9a1e1ce0a4f4c92ba744aa3ce63f5', 'request_id': 'req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:09.131842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd9a1e1ce0a4f4c92ba744aa3ce63f5', 'request_id': 'req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:09.143567 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] The token cache is being invalidate because project 8bd9a1e1ce0a4f4c92ba744aa3ce63f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:38:09.143852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:09.144606 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e1949fab-0f54-46f9-9c08-d7f6e74b7b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:09.146377 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1327/2635] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:38:08 2022] DELETE /identity/v3/projects/8bd9a1e1ce0a4f4c92ba744aa3ce63f5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:09.151532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcaf1a-5471-4ade-aca5-bb222fc2bb2a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.151817 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcaf1a-5471-4ade-aca5-bb222fc2bb2a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.152087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcaf1a-5471-4ade-aca5-bb222fc2bb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.171418 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7efcaf1a-5471-4ade-aca5-bb222fc2bb2a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:09.172654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7efcaf1a-5471-4ade-aca5-bb222fc2bb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:09.233570 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1309/2636] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:09.241719 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ed79-313c-4c09-b1d5-f6fc699a26ba None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.242010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ed79-313c-4c09-b1d5-f6fc699a26ba None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.242265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ed79-313c-4c09-b1d5-f6fc699a26ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.260559 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e6d7ed79-313c-4c09-b1d5-f6fc699a26ba None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:09.261777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6d7ed79-313c-4c09-b1d5-f6fc699a26ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:09.273270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1328/2637] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:09.274497 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcaf1a-5471-4ade-aca5-bb222fc2bb2a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:09.284541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcaf1a-5471-4ade-aca5-bb222fc2bb2a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:09.289678 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f125fba-ca80-4910-bc41-349b6ea6fe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:09.290337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f125fba-ca80-4910-bc41-349b6ea6fe51 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.290616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f125fba-ca80-4910-bc41-349b6ea6fe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.290885 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f125fba-ca80-4910-bc41-349b6ea6fe51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.291637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f125fba-ca80-4910-bc41-349b6ea6fe51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:38:09.291943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f125fba-ca80-4910-bc41-349b6ea6fe51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:09.293593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f125fba-ca80-4910-bc41-349b6ea6fe51 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:09.306212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1310/2638] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:38:09.310542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7ed79-313c-4c09-b1d5-f6fc699a26ba None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:09.319794 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7ed79-313c-4c09-b1d5-f6fc699a26ba None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:09.324497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0c6da-eaa9-4f4d-a41a-60f6f3cd1a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:09.325182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c6da-eaa9-4f4d-a41a-60f6f3cd1a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.325458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c6da-eaa9-4f4d-a41a-60f6f3cd1a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.325734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c6da-eaa9-4f4d-a41a-60f6f3cd1a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.326421 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0c6da-eaa9-4f4d-a41a-60f6f3cd1a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:09.328321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0c6da-eaa9-4f4d-a41a-60f6f3cd1a46 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:09.355536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1329/2639] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:38:09 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:38:09.359682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f125fba-ca80-4910-bc41-349b6ea6fe51 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:09.369816 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f125fba-ca80-4910-bc41-349b6ea6fe51 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:09.426738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44887e-2d5d-46a5-889e-0b7019640cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:09.427410 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44887e-2d5d-46a5-889e-0b7019640cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.427687 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44887e-2d5d-46a5-889e-0b7019640cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.427958 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44887e-2d5d-46a5-889e-0b7019640cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.428647 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44887e-2d5d-46a5-889e-0b7019640cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:09.430612 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44887e-2d5d-46a5-889e-0b7019640cb4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:09.437292 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:09.464819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1311/2640] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:38:09 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:38:09.469535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0c6da-eaa9-4f4d-a41a-60f6f3cd1a46 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:09.480750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0c6da-eaa9-4f4d-a41a-60f6f3cd1a46 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:09.486672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83938096-4626-4abc-a861-ba18916d7fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:09.487369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83938096-4626-4abc-a861-ba18916d7fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.487646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83938096-4626-4abc-a861-ba18916d7fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.487911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83938096-4626-4abc-a861-ba18916d7fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.488647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83938096-4626-4abc-a861-ba18916d7fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:09.490286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83938096-4626-4abc-a861-ba18916d7fa5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:09.501423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1330/2641] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:38:09.505841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44887e-2d5d-46a5-889e-0b7019640cb4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:09.516532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44887e-2d5d-46a5-889e-0b7019640cb4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:09.522093 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6163a-756a-4082-88e7-594137a546ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:09.522788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6163a-756a-4082-88e7-594137a546ad admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.523068 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6163a-756a-4082-88e7-594137a546ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.523335 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6163a-756a-4082-88e7-594137a546ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.524084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6163a-756a-4082-88e7-594137a546ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:09.525756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6163a-756a-4082-88e7-594137a546ad admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:09.536232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1312/2642] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:38:09.540528 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83938096-4626-4abc-a861-ba18916d7fa5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:09.551042 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83938096-4626-4abc-a861-ba18916d7fa5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:09.556786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae523e-ad51-4452-bc1c-f666f68592ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:09.557781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae523e-ad51-4452-bc1c-f666f68592ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.558055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae523e-ad51-4452-bc1c-f666f68592ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.558323 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae523e-ad51-4452-bc1c-f666f68592ea admin admin] PATH_INFO: `/v3/projects/748942b14b014c869ef36c668d6e0b75/users/b377f2751fa2446597aa6871650ec2f9/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.576362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae523e-ad51-4452-bc1c-f666f68592ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=748942b14b014c869ef36c668d6e0b75, user_id=b377f2751fa2446597aa6871650ec2f9, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:09.579085 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae523e-ad51-4452-bc1c-f666f68592ea admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:09.593327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1331/2643] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:38:09 2022] PUT /identity/v3/projects/748942b14b014c869ef36c668d6e0b75/users/b377f2751fa2446597aa6871650ec2f9/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:38:09.601750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46acc2-15c4-4a24-81d6-066df484e29b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.601979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46acc2-15c4-4a24-81d6-066df484e29b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.602247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46acc2-15c4-4a24-81d6-066df484e29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.623667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4a46acc2-15c4-4a24-81d6-066df484e29b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:09.624891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4a46acc2-15c4-4a24-81d6-066df484e29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:09.689589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1313/2644] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:09.699572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae523e-ad51-4452-bc1c-f666f68592ea admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:09.701747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cfae523e-ad51-4452-bc1c-f666f68592ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:09.762698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae523e-ad51-4452-bc1c-f666f68592ea admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:09.766868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03b039-5696-4eb5-9515-9fc53ead7f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:09.767511 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03b039-5696-4eb5-9515-9fc53ead7f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.767789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03b039-5696-4eb5-9515-9fc53ead7f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.768060 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03b039-5696-4eb5-9515-9fc53ead7f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.781122 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03b039-5696-4eb5-9515-9fc53ead7f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:09.782586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03b039-5696-4eb5-9515-9fc53ead7f4b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:09.792493 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1332/2645] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:09.841212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46acc2-15c4-4a24-81d6-066df484e29b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:09.842958 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4a46acc2-15c4-4a24-81d6-066df484e29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:09.855972 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46acc2-15c4-4a24-81d6-066df484e29b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:09.860862 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:09.863603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.863956 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.864293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] PATH_INFO: `/v3/users/6bd8b82a61854e419a3d4e09126ce2c7` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.865573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd8b82a61854e419a3d4e09126ce2c7)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:09.867645 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:09.916616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd8b82a61854e419a3d4e09126ce2c7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:09.929322 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd8b82a61854e419a3d4e09126ce2c7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:09.930042 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd8b82a61854e419a3d4e09126ce2c7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:09.930650 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd8b82a61854e419a3d4e09126ce2c7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:09.938054 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd8b82a61854e419a3d4e09126ce2c7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:09.961009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1314/2646] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:38:09 2022] DELETE /identity/v3/users/6bd8b82a61854e419a3d4e09126ce2c7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:09.966548 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6734d2d-34c7-4fbd-bc0a-93fb6a364fbb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:09.966836 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6734d2d-34c7-4fbd-bc0a-93fb6a364fbb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:09.967106 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6734d2d-34c7-4fbd-bc0a-93fb6a364fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:09.985602 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e6734d2d-34c7-4fbd-bc0a-93fb6a364fbb None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:09.986805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6734d2d-34c7-4fbd-bc0a-93fb6a364fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:10.046171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1333/2647] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:10.056481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:10.058033 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:10.123750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5777f60-d884-4ca2-a083-ea9481c5fc83 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:10.128170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03becc1-7402-455d-8a86-531589babd97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:10.128841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03becc1-7402-455d-8a86-531589babd97 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:10.129219 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03becc1-7402-455d-8a86-531589babd97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:10.129492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03becc1-7402-455d-8a86-531589babd97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:10.136582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:10.140412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03becc1-7402-455d-8a86-531589babd97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:10.142156 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03becc1-7402-455d-8a86-531589babd97 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:10.154409 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1315/2648] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:10.576469 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6734d2d-34c7-4fbd-bc0a-93fb6a364fbb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:10.577941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6734d2d-34c7-4fbd-bc0a-93fb6a364fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:10.590446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6734d2d-34c7-4fbd-bc0a-93fb6a364fbb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:10.595375 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:10.596255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:10.596532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:10.596809 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] PATH_INFO: `/v3/projects/868f2878113d4ca386c4d345db6a9880` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:10.598243 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868f2878113d4ca386c4d345db6a9880)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:10.600168 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:10.618905 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:10.664849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868f2878113d4ca386c4d345db6a9880', 'request_id': 'req-e45bdcc0-b22d-4377-82ad-9e645489d640'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:10.676796 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868f2878113d4ca386c4d345db6a9880', 'request_id': 'req-e45bdcc0-b22d-4377-82ad-9e645489d640'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:10.684617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868f2878113d4ca386c4d345db6a9880', 'request_id': 'req-e45bdcc0-b22d-4377-82ad-9e645489d640'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:10.697441 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] The token cache is being invalidate because project 868f2878113d4ca386c4d345db6a9880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:38:10.697789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:10.698556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:10.703189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1334/2649] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:38:10 2022] DELETE /identity/v3/projects/868f2878113d4ca386c4d345db6a9880 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:10.704428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03becc1-7402-455d-8a86-531589babd97 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:10.714829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03becc1-7402-455d-8a86-531589babd97 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:10.782961 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cdc06-a11b-48f4-9a8e-fe5e73a83455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:10.784195 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdc06-a11b-48f4-9a8e-fe5e73a83455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:10.784637 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdc06-a11b-48f4-9a8e-fe5e73a83455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:10.785116 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdc06-a11b-48f4-9a8e-fe5e73a83455 admin admin] PATH_INFO: `/v3/users/31e78afdfabe4e5894c8e75653b9ba0e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:10.786613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cdc06-a11b-48f4-9a8e-fe5e73a83455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e78afdfabe4e5894c8e75653b9ba0e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:10.788616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cdc06-a11b-48f4-9a8e-fe5e73a83455 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:10.853483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ea5cdc06-a11b-48f4-9a8e-fe5e73a83455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e78afdfabe4e5894c8e75653b9ba0e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:10.869853 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ea5cdc06-a11b-48f4-9a8e-fe5e73a83455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e78afdfabe4e5894c8e75653b9ba0e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:10.871689 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ea5cdc06-a11b-48f4-9a8e-fe5e73a83455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e78afdfabe4e5894c8e75653b9ba0e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:10.873417 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ea5cdc06-a11b-48f4-9a8e-fe5e73a83455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e78afdfabe4e5894c8e75653b9ba0e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:10.882282 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ea5cdc06-a11b-48f4-9a8e-fe5e73a83455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e78afdfabe4e5894c8e75653b9ba0e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:10.899384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1316/2650] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:38:10 2022] DELETE /identity/v3/users/31e78afdfabe4e5894c8e75653b9ba0e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:11.369663 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:11.371828 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:11.397706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdcc0-b22d-4377-82ad-9e645489d640 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:11.505932 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:11.506826 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:11.507547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:11.507547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] PATH_INFO: `/v3/projects/0b7799a739324016a98066faa855e11a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:11.508741 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7799a739324016a98066faa855e11a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:11.510730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:11.570217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7799a739324016a98066faa855e11a', 'request_id': 'req-677f3d2a-eec4-43b7-833e-4585fba38680'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:11.578980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7799a739324016a98066faa855e11a', 'request_id': 'req-677f3d2a-eec4-43b7-833e-4585fba38680'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:11.585086 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7799a739324016a98066faa855e11a', 'request_id': 'req-677f3d2a-eec4-43b7-833e-4585fba38680'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:11.597016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] The token cache is being invalidate because project 0b7799a739324016a98066faa855e11a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:38:11.597374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:11.598184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-677f3d2a-eec4-43b7-833e-4585fba38680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:11.600408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1335/2651] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:38:11 2022] DELETE /identity/v3/projects/0b7799a739324016a98066faa855e11a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:11.605407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed0c5f-6f77-4a2d-8b0b-d6364f84de5c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:11.605691 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed0c5f-6f77-4a2d-8b0b-d6364f84de5c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:11.605960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed0c5f-6f77-4a2d-8b0b-d6364f84de5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:11.625154 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7bed0c5f-6f77-4a2d-8b0b-d6364f84de5c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:11.626467 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7bed0c5f-6f77-4a2d-8b0b-d6364f84de5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:11.701516 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1317/2652] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:11.709799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ff6d-fa60-4580-b215-2cbbc5389192 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:11.710170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ff6d-fa60-4580-b215-2cbbc5389192 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:11.710790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ff6d-fa60-4580-b215-2cbbc5389192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:11.739286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6a72ff6d-fa60-4580-b215-2cbbc5389192 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:11.740453 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6a72ff6d-fa60-4580-b215-2cbbc5389192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:11.748643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1336/2653] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:11.753255 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed0c5f-6f77-4a2d-8b0b-d6364f84de5c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:11.762960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed0c5f-6f77-4a2d-8b0b-d6364f84de5c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:11.767534 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cfa0d-d2e2-4595-9bad-12ad7f3c31d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:11.768196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cfa0d-d2e2-4595-9bad-12ad7f3c31d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:11.768474 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cfa0d-d2e2-4595-9bad-12ad7f3c31d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:11.768743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cfa0d-d2e2-4595-9bad-12ad7f3c31d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:11.769541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cfa0d-d2e2-4595-9bad-12ad7f3c31d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:38:11.769852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cfa0d-d2e2-4595-9bad-12ad7f3c31d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:11.771450 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cfa0d-d2e2-4595-9bad-12ad7f3c31d4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:11.780010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:11.785218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1318/2654] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:38:11.788263 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72ff6d-fa60-4580-b215-2cbbc5389192 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:11.797750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72ff6d-fa60-4580-b215-2cbbc5389192 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:11.802501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328f56-8382-40c9-b75f-f1f6ac90cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:11.803181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328f56-8382-40c9-b75f-f1f6ac90cb1c admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:11.803468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328f56-8382-40c9-b75f-f1f6ac90cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:11.803746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328f56-8382-40c9-b75f-f1f6ac90cb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:11.804492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8328f56-8382-40c9-b75f-f1f6ac90cb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:11.806431 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8328f56-8382-40c9-b75f-f1f6ac90cb1c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:11.834827 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1337/2655] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:38:11 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:38:11.839094 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cfa0d-d2e2-4595-9bad-12ad7f3c31d4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:11.849891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cfa0d-d2e2-4595-9bad-12ad7f3c31d4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:11.917206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15239c-23fd-436f-b25d-4b15af435e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:11.917908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15239c-23fd-436f-b25d-4b15af435e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:11.918190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15239c-23fd-436f-b25d-4b15af435e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:11.918463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15239c-23fd-436f-b25d-4b15af435e18 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:11.919249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15239c-23fd-436f-b25d-4b15af435e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:11.921241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15239c-23fd-436f-b25d-4b15af435e18 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:11.945095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1319/2656] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:38:11 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:38:11.949549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328f56-8382-40c9-b75f-f1f6ac90cb1c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:11.957994 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:11.964100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328f56-8382-40c9-b75f-f1f6ac90cb1c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:11.976521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e993f-4ee1-4d0a-ab6e-94031c7c05c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:11.976521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e993f-4ee1-4d0a-ab6e-94031c7c05c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:11.976521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e993f-4ee1-4d0a-ab6e-94031c7c05c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:11.976521 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e993f-4ee1-4d0a-ab6e-94031c7c05c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:11.978789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e993f-4ee1-4d0a-ab6e-94031c7c05c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:11.978789 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e993f-4ee1-4d0a-ab6e-94031c7c05c6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:11.990899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1338/2657] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:38:11.994690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15239c-23fd-436f-b25d-4b15af435e18 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:12.005988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15239c-23fd-436f-b25d-4b15af435e18 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:12.012604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2ff35-6ce8-437d-86be-ccc4debaefa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:12.013348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2ff35-6ce8-437d-86be-ccc4debaefa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:12.013687 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2ff35-6ce8-437d-86be-ccc4debaefa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:12.013894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2ff35-6ce8-437d-86be-ccc4debaefa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:12.014660 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2ff35-6ce8-437d-86be-ccc4debaefa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:12.016332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2ff35-6ce8-437d-86be-ccc4debaefa4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:12.034211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1320/2658] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:38:12.038304 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e993f-4ee1-4d0a-ab6e-94031c7c05c6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:12.051103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e993f-4ee1-4d0a-ab6e-94031c7c05c6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:12.055946 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7acc8-ac37-4d90-9d96-ea517fc0985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:12.056974 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7acc8-ac37-4d90-9d96-ea517fc0985f admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:12.057333 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7acc8-ac37-4d90-9d96-ea517fc0985f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:12.057684 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7acc8-ac37-4d90-9d96-ea517fc0985f admin admin] PATH_INFO: `/v3/projects/a816cf4512ed46d8a710753283b3ef51/users/e513aa15a88c43ce819d257b98e3ad19/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:12.076620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7acc8-ac37-4d90-9d96-ea517fc0985f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a816cf4512ed46d8a710753283b3ef51, user_id=e513aa15a88c43ce819d257b98e3ad19, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:12.079572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7acc8-ac37-4d90-9d96-ea517fc0985f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:12.096923 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1339/2659] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:38:12 2022] PUT /identity/v3/projects/a816cf4512ed46d8a710753283b3ef51/users/e513aa15a88c43ce819d257b98e3ad19/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:12.108904 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970bf24-9ae0-4537-bf06-5f413a3992b6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:12.109328 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970bf24-9ae0-4537-bf06-5f413a3992b6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:12.109638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970bf24-9ae0-4537-bf06-5f413a3992b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:12.139422 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4970bf24-9ae0-4537-bf06-5f413a3992b6 None None] MFA Rules not processed for user `e513aa15a88c43ce819d257b98e3ad19`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:12.140927 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4970bf24-9ae0-4537-bf06-5f413a3992b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:12.212311 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1321/2660] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:12.224182 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7acc8-ac37-4d90-9d96-ea517fc0985f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:12.225956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ade7acc8-ac37-4d90-9d96-ea517fc0985f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:12.298063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7acc8-ac37-4d90-9d96-ea517fc0985f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:12.302320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581e4ed-4ce6-4d3b-8a03-15c1c2782cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:12.302984 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e4ed-4ce6-4d3b-8a03-15c1c2782cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:12.303260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e4ed-4ce6-4d3b-8a03-15c1c2782cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:12.303533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e4ed-4ce6-4d3b-8a03-15c1c2782cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:12.313389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581e4ed-4ce6-4d3b-8a03-15c1c2782cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:12.315092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581e4ed-4ce6-4d3b-8a03-15c1c2782cb6 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:12.326024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1340/2661] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:13.272318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970bf24-9ae0-4537-bf06-5f413a3992b6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:13.284013 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970bf24-9ae0-4537-bf06-5f413a3992b6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:13.288264 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cae961-fe36-4b0b-9461-e0baaa36b537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:13.289806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cae961-fe36-4b0b-9461-e0baaa36b537 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:13.290212 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cae961-fe36-4b0b-9461-e0baaa36b537 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:13.290657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cae961-fe36-4b0b-9461-e0baaa36b537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:13.293332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a7cae961-fe36-4b0b-9461-e0baaa36b537 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:13.383876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cae961-fe36-4b0b-9461-e0baaa36b537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:13.386274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cae961-fe36-4b0b-9461-e0baaa36b537 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:13.399284 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1322/2662] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:14.168497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218459e-a1ce-4e52-941a-fa87fa186052 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:14.168898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218459e-a1ce-4e52-941a-fa87fa186052 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:14.169195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218459e-a1ce-4e52-941a-fa87fa186052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:14.195264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0218459e-a1ce-4e52-941a-fa87fa186052 None None] MFA Rules not processed for user `b377f2751fa2446597aa6871650ec2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:14.196489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0218459e-a1ce-4e52-941a-fa87fa186052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:14.276935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1341/2663] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:38:14.291257 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cae961-fe36-4b0b-9461-e0baaa36b537 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:14.292732 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a7cae961-fe36-4b0b-9461-e0baaa36b537 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:14.303087 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:14.384103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cae961-fe36-4b0b-9461-e0baaa36b537 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:14.390016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1b0f-9add-4c7c-bcbb-4872b987237a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:14.390724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1b0f-9add-4c7c-bcbb-4872b987237a service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:14.390998 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1b0f-9add-4c7c-bcbb-4872b987237a service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:14.391331 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1b0f-9add-4c7c-bcbb-4872b987237a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:14.403639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1b0f-9add-4c7c-bcbb-4872b987237a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:14.406475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1b0f-9add-4c7c-bcbb-4872b987237a service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:14.417928 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1323/2664] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:15.753625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f2863-8f85-4df0-9538-27fa1dc45f8a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:15.754132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f2863-8f85-4df0-9538-27fa1dc45f8a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:15.754132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f2863-8f85-4df0-9538-27fa1dc45f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:15.772437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-460f2863-8f85-4df0-9538-27fa1dc45f8a None None] MFA Rules not processed for user `b377f2751fa2446597aa6871650ec2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:15.773669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-460f2863-8f85-4df0-9538-27fa1dc45f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:15.781592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1342/2665] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:21.508589 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81730-4e6a-4302-9245-7195c52f31d6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:21.509121 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81730-4e6a-4302-9245-7195c52f31d6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:21.509231 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81730-4e6a-4302-9245-7195c52f31d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:21.527569 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cbb81730-4e6a-4302-9245-7195c52f31d6 None None] MFA Rules not processed for user `e23fcb16b89d4fe6a6f03466f8d0d575`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:21.528790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cbb81730-4e6a-4302-9245-7195c52f31d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:21.535999 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1324/2666] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:22.964448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f2863-8f85-4df0-9538-27fa1dc45f8a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:23.030189 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:23.037260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f2863-8f85-4df0-9538-27fa1dc45f8a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:23.043507 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:23.044399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:23.044678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:23.044949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] PATH_INFO: `/v3/users/e513aa15a88c43ce819d257b98e3ad19` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:23.046214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e513aa15a88c43ce819d257b98e3ad19)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:23.048215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:23.100839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e513aa15a88c43ce819d257b98e3ad19'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:23.113792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e513aa15a88c43ce819d257b98e3ad19'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:23.114509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e513aa15a88c43ce819d257b98e3ad19'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:23.124110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e513aa15a88c43ce819d257b98e3ad19'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:23.134234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e513aa15a88c43ce819d257b98e3ad19'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:23.140730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1343/2667] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:38:22 2022] DELETE /identity/v3/users/e513aa15a88c43ce819d257b98e3ad19 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:23.146573 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859dbd0-dd42-4e53-9a76-f12406b5fa91 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:23.147623 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859dbd0-dd42-4e53-9a76-f12406b5fa91 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:23.147917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859dbd0-dd42-4e53-9a76-f12406b5fa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:23.167630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5859dbd0-dd42-4e53-9a76-f12406b5fa91 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:23.169127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5859dbd0-dd42-4e53-9a76-f12406b5fa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:23.241897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1325/2668] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:23.252340 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:23.254181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:23.325056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84cc6e-e453-49d3-bff6-e3aefe0ac2ac admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:23.329678 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca07969-0264-41a9-a1f2-36ab1e76f5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:23.330384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca07969-0264-41a9-a1f2-36ab1e76f5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:23.330566 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca07969-0264-41a9-a1f2-36ab1e76f5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:23.330805 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca07969-0264-41a9-a1f2-36ab1e76f5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:23.341693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca07969-0264-41a9-a1f2-36ab1e76f5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:23.343554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca07969-0264-41a9-a1f2-36ab1e76f5f8 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:23.354025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1344/2669] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:23.921220 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859dbd0-dd42-4e53-9a76-f12406b5fa91 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:23.922788 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5859dbd0-dd42-4e53-9a76-f12406b5fa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:23.935182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859dbd0-dd42-4e53-9a76-f12406b5fa91 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:23.941117 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:23.942388 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:23.942756 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:23.942893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] PATH_INFO: `/v3/projects/a816cf4512ed46d8a710753283b3ef51` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:23.944214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a816cf4512ed46d8a710753283b3ef51)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:23.946201 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:24.014742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a816cf4512ed46d8a710753283b3ef51', 'request_id': 'req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:24.022599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a816cf4512ed46d8a710753283b3ef51', 'request_id': 'req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:24.028478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a816cf4512ed46d8a710753283b3ef51', 'request_id': 'req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:24.039762 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] The token cache is being invalidate because project a816cf4512ed46d8a710753283b3ef51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:38:24.040049 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:24.040697 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-afb6d2fa-b08c-449f-bcb6-6b2bed1101f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:24.042310 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1326/2670] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:38:23 2022] DELETE /identity/v3/projects/a816cf4512ed46d8a710753283b3ef51 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:24.047282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ea8f5-2969-4527-99be-8e845f3da961 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:24.047765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ea8f5-2969-4527-99be-8e845f3da961 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:24.047862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ea8f5-2969-4527-99be-8e845f3da961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:24.065502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a48ea8f5-2969-4527-99be-8e845f3da961 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:24.066726 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a48ea8f5-2969-4527-99be-8e845f3da961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:24.129572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1345/2671] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:24.137448 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2a110-3a77-4927-8330-7f52eca7560d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:24.137739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2a110-3a77-4927-8330-7f52eca7560d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:24.138018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2a110-3a77-4927-8330-7f52eca7560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:24.157920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bde2a110-3a77-4927-8330-7f52eca7560d None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:24.159204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bde2a110-3a77-4927-8330-7f52eca7560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:24.168159 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1327/2672] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:24.172463 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ea8f5-2969-4527-99be-8e845f3da961 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:24.183829 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ea8f5-2969-4527-99be-8e845f3da961 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:24.189000 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff3e3d-b687-439d-8433-fbd82572831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:24.189699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff3e3d-b687-439d-8433-fbd82572831b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:24.189986 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff3e3d-b687-439d-8433-fbd82572831b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:24.190299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff3e3d-b687-439d-8433-fbd82572831b admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:24.191046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff3e3d-b687-439d-8433-fbd82572831b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:38:24.191362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff3e3d-b687-439d-8433-fbd82572831b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:24.193008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff3e3d-b687-439d-8433-fbd82572831b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:24.207628 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1346/2673] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:38:24.212299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2a110-3a77-4927-8330-7f52eca7560d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:24.216811 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:24.225586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2a110-3a77-4927-8330-7f52eca7560d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:24.231855 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24d3e-5c52-4b76-b678-faaf9c67eb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:24.232556 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24d3e-5c52-4b76-b678-faaf9c67eb48 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:24.233069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24d3e-5c52-4b76-b678-faaf9c67eb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:24.233454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24d3e-5c52-4b76-b678-faaf9c67eb48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:24.234339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd24d3e-5c52-4b76-b678-faaf9c67eb48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:24.236472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd24d3e-5c52-4b76-b678-faaf9c67eb48 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:24.268237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1328/2674] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:38:24 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:38:24.272711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff3e3d-b687-439d-8433-fbd82572831b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:24.280470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:24.285331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff3e3d-b687-439d-8433-fbd82572831b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:24.361186 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ab88e-9845-4d52-b74e-241de090c147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:24.361896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab88e-9845-4d52-b74e-241de090c147 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:24.362246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab88e-9845-4d52-b74e-241de090c147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:24.362531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab88e-9845-4d52-b74e-241de090c147 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:24.363319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ab88e-9845-4d52-b74e-241de090c147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:24.365275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ab88e-9845-4d52-b74e-241de090c147 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:24.393234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1347/2675] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:38:24 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:38:24.394493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24d3e-5c52-4b76-b678-faaf9c67eb48 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:24.405217 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24d3e-5c52-4b76-b678-faaf9c67eb48 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:24.411205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e9e88-94cf-49dd-a137-48dc300fc8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:24.412502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e9e88-94cf-49dd-a137-48dc300fc8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:24.413010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e9e88-94cf-49dd-a137-48dc300fc8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:24.413728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e9e88-94cf-49dd-a137-48dc300fc8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:24.414692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e9e88-94cf-49dd-a137-48dc300fc8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:24.417441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e9e88-94cf-49dd-a137-48dc300fc8a2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:24.429735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1329/2676] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:38:24.433677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ab88e-9845-4d52-b74e-241de090c147 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:24.444369 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ab88e-9845-4d52-b74e-241de090c147 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:24.451989 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5568dcd-2a10-44ee-aa85-2340a1732e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:24.452753 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568dcd-2a10-44ee-aa85-2340a1732e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:24.452975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568dcd-2a10-44ee-aa85-2340a1732e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:24.453265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568dcd-2a10-44ee-aa85-2340a1732e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:24.454020 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5568dcd-2a10-44ee-aa85-2340a1732e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:24.455607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5568dcd-2a10-44ee-aa85-2340a1732e06 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:24.466526 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1348/2677] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:38:24.470954 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e9e88-94cf-49dd-a137-48dc300fc8a2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:24.483962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e9e88-94cf-49dd-a137-48dc300fc8a2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:24.490012 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716a4f7-ec64-49d0-95a2-8ce5a6dd8baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:24.490950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716a4f7-ec64-49d0-95a2-8ce5a6dd8baf admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:24.491166 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716a4f7-ec64-49d0-95a2-8ce5a6dd8baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:24.491657 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716a4f7-ec64-49d0-95a2-8ce5a6dd8baf admin admin] PATH_INFO: `/v3/projects/66dbcf1a35b5411aa0f324813b84ee2c/users/42760e256054448e8ebb75df391568c2/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:24.510963 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716a4f7-ec64-49d0-95a2-8ce5a6dd8baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=66dbcf1a35b5411aa0f324813b84ee2c, user_id=42760e256054448e8ebb75df391568c2, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:24.513698 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716a4f7-ec64-49d0-95a2-8ce5a6dd8baf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:24.536977 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1330/2678] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:38:24 2022] PUT /identity/v3/projects/66dbcf1a35b5411aa0f324813b84ee2c/users/42760e256054448e8ebb75df391568c2/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:24.547167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ddedc-bb43-4a6b-aab7-0cecaf709b84 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:24.548615 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ddedc-bb43-4a6b-aab7-0cecaf709b84 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:24.549160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ddedc-bb43-4a6b-aab7-0cecaf709b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:24.585797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f36ddedc-bb43-4a6b-aab7-0cecaf709b84 None None] MFA Rules not processed for user `42760e256054448e8ebb75df391568c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:24.588009 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f36ddedc-bb43-4a6b-aab7-0cecaf709b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:24.682519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1349/2679] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:24.687256 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716a4f7-ec64-49d0-95a2-8ce5a6dd8baf admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:24.816247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716a4f7-ec64-49d0-95a2-8ce5a6dd8baf admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:24.825923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35136c8e-00d4-41a3-b39a-5e0e94a944f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:24.826622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136c8e-00d4-41a3-b39a-5e0e94a944f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:24.826897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136c8e-00d4-41a3-b39a-5e0e94a944f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:24.831109 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136c8e-00d4-41a3-b39a-5e0e94a944f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:24.831945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35136c8e-00d4-41a3-b39a-5e0e94a944f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:24.833941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35136c8e-00d4-41a3-b39a-5e0e94a944f4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:24.882367 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1331/2680] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:38:24 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:38:24.885076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ddedc-bb43-4a6b-aab7-0cecaf709b84 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:24.913219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ddedc-bb43-4a6b-aab7-0cecaf709b84 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:25.045212 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384471-545e-4c8c-92f2-3af55e9f4fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:25.045939 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384471-545e-4c8c-92f2-3af55e9f4fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.046204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384471-545e-4c8c-92f2-3af55e9f4fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.046482 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384471-545e-4c8c-92f2-3af55e9f4fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.047197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384471-545e-4c8c-92f2-3af55e9f4fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:25.049172 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384471-545e-4c8c-92f2-3af55e9f4fe8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:25.075371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1350/2681] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:38:24 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:38:25.079783 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35136c8e-00d4-41a3-b39a-5e0e94a944f4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:25.094085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35136c8e-00d4-41a3-b39a-5e0e94a944f4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:25.099575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d13b45-fb1a-407c-9116-6c894ba9d61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:25.100274 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d13b45-fb1a-407c-9116-6c894ba9d61e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.100555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d13b45-fb1a-407c-9116-6c894ba9d61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.101025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d13b45-fb1a-407c-9116-6c894ba9d61e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.101860 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d13b45-fb1a-407c-9116-6c894ba9d61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:25.103583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d13b45-fb1a-407c-9116-6c894ba9d61e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:25.116247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1332/2682] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:38:25.120882 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384471-545e-4c8c-92f2-3af55e9f4fe8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:25.127827 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:25.134324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384471-545e-4c8c-92f2-3af55e9f4fe8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:25.143557 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630f3cb-beb7-4d6d-8d10-194e9ad1a2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:25.144335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630f3cb-beb7-4d6d-8d10-194e9ad1a2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.144758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630f3cb-beb7-4d6d-8d10-194e9ad1a2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.145711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630f3cb-beb7-4d6d-8d10-194e9ad1a2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.145857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630f3cb-beb7-4d6d-8d10-194e9ad1a2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:25.147485 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630f3cb-beb7-4d6d-8d10-194e9ad1a2cd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:25.159832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1351/2683] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:38:25.163919 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d13b45-fb1a-407c-9116-6c894ba9d61e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:25.174544 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d13b45-fb1a-407c-9116-6c894ba9d61e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:25.180463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a2a51-ae56-4511-afa0-b85b020b1091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:25.181479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2a51-ae56-4511-afa0-b85b020b1091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.181765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2a51-ae56-4511-afa0-b85b020b1091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.182044 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2a51-ae56-4511-afa0-b85b020b1091 admin admin] PATH_INFO: `/v3/projects/26ab98bcf8244a8c81c1c3ff79f3b497/users/9d2414030ab9474fb2d3184e6c8ef656/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.210426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a2a51-ae56-4511-afa0-b85b020b1091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ab98bcf8244a8c81c1c3ff79f3b497, user_id=9d2414030ab9474fb2d3184e6c8ef656, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:25.213165 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a2a51-ae56-4511-afa0-b85b020b1091 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:25.236356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1333/2684] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:38:25 2022] PUT /identity/v3/projects/26ab98bcf8244a8c81c1c3ff79f3b497/users/9d2414030ab9474fb2d3184e6c8ef656/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:25.251842 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc7fbf-b756-4fec-bc40-79453409a634 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.252389 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc7fbf-b756-4fec-bc40-79453409a634 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.252993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc7fbf-b756-4fec-bc40-79453409a634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.286792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3edc7fbf-b756-4fec-bc40-79453409a634 None None] MFA Rules not processed for user `9d2414030ab9474fb2d3184e6c8ef656`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:25.288708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3edc7fbf-b756-4fec-bc40-79453409a634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:25.367184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1352/2685] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:25.371932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a2a51-ae56-4511-afa0-b85b020b1091 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:25.431057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:25.438050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a2a51-ae56-4511-afa0-b85b020b1091 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:25.444209 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fb5e5-716d-405f-bc89-93e21984fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:25.444880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fb5e5-716d-405f-bc89-93e21984fb76 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.445189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fb5e5-716d-405f-bc89-93e21984fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.445462 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fb5e5-716d-405f-bc89-93e21984fb76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.446167 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fb5e5-716d-405f-bc89-93e21984fb76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:25.448082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fb5e5-716d-405f-bc89-93e21984fb76 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:25.476872 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1334/2686] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:38:25 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:38:25.480922 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc7fbf-b756-4fec-bc40-79453409a634 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:25.492704 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc7fbf-b756-4fec-bc40-79453409a634 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:25.548853 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37ed46-c77b-40e0-a33e-bc19c26ddb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:25.549627 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37ed46-c77b-40e0-a33e-bc19c26ddb1d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.550006 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37ed46-c77b-40e0-a33e-bc19c26ddb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.550280 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37ed46-c77b-40e0-a33e-bc19c26ddb1d admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.550968 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37ed46-c77b-40e0-a33e-bc19c26ddb1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:25.552886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37ed46-c77b-40e0-a33e-bc19c26ddb1d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:25.573587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1353/2687] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:38:25 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:38:25.577749 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fb5e5-716d-405f-bc89-93e21984fb76 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:25.588793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fb5e5-716d-405f-bc89-93e21984fb76 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:25.594388 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210610d-539a-44a7-8171-e52454a592b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:25.595059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210610d-539a-44a7-8171-e52454a592b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.595343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210610d-539a-44a7-8171-e52454a592b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.595618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210610d-539a-44a7-8171-e52454a592b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.596363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210610d-539a-44a7-8171-e52454a592b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:25.598610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210610d-539a-44a7-8171-e52454a592b5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:25.609583 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1335/2688] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:38:25.614092 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37ed46-c77b-40e0-a33e-bc19c26ddb1d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:25.624795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37ed46-c77b-40e0-a33e-bc19c26ddb1d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:25.630708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8e44-4cce-4e5f-a9e3-a3c2b169fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:25.631610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8e44-4cce-4e5f-a9e3-a3c2b169fa30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.631885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8e44-4cce-4e5f-a9e3-a3c2b169fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.632193 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8e44-4cce-4e5f-a9e3-a3c2b169fa30 admin admin] PATH_INFO: `/v3/projects/3147e3d4483d401fbc0345de16b336c5/users/a0c4fa92d43a495d84321b7fb36fd19d/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.648281 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8e44-4cce-4e5f-a9e3-a3c2b169fa30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3147e3d4483d401fbc0345de16b336c5, user_id=a0c4fa92d43a495d84321b7fb36fd19d, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:25.650961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8e44-4cce-4e5f-a9e3-a3c2b169fa30 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:25.667958 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1354/2689] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:38:25 2022] PUT /identity/v3/projects/3147e3d4483d401fbc0345de16b336c5/users/a0c4fa92d43a495d84321b7fb36fd19d/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:25.672125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210610d-539a-44a7-8171-e52454a592b5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:25.682504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210610d-539a-44a7-8171-e52454a592b5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:25.745170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32549838-ecd4-4ac9-ad6f-0eeb9d2f3567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:25.745543 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32549838-ecd4-4ac9-ad6f-0eeb9d2f3567 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.745742 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32549838-ecd4-4ac9-ad6f-0eeb9d2f3567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.746002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32549838-ecd4-4ac9-ad6f-0eeb9d2f3567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.747320 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32549838-ecd4-4ac9-ad6f-0eeb9d2f3567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:25.748466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32549838-ecd4-4ac9-ad6f-0eeb9d2f3567 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:25.759138 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1336/2690] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:38:25.763479 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8e44-4cce-4e5f-a9e3-a3c2b169fa30 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:25.774852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8e44-4cce-4e5f-a9e3-a3c2b169fa30 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:25.780712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924806ca-6fa7-497a-9d1b-fe0930b4a572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:25.782046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924806ca-6fa7-497a-9d1b-fe0930b4a572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.782549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924806ca-6fa7-497a-9d1b-fe0930b4a572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.783076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924806ca-6fa7-497a-9d1b-fe0930b4a572 admin admin] PATH_INFO: `/v3/projects/3147e3d4483d401fbc0345de16b336c5/users/a0c4fa92d43a495d84321b7fb36fd19d/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.785275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924806ca-6fa7-497a-9d1b-fe0930b4a572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3147e3d4483d401fbc0345de16b336c5, user_id=a0c4fa92d43a495d84321b7fb36fd19d, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:25.787987 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924806ca-6fa7-497a-9d1b-fe0930b4a572 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:25.810358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1355/2691] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:38:25 2022] PUT /identity/v3/projects/3147e3d4483d401fbc0345de16b336c5/users/a0c4fa92d43a495d84321b7fb36fd19d/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:25.820231 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e310-0a0d-43a6-854f-fa1264756ee6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:25.820925 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e310-0a0d-43a6-854f-fa1264756ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:25.821176 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e310-0a0d-43a6-854f-fa1264756ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:25.854237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6822e310-0a0d-43a6-854f-fa1264756ee6 None None] MFA Rules not processed for user `a0c4fa92d43a495d84321b7fb36fd19d`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:25.855481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6822e310-0a0d-43a6-854f-fa1264756ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:25.927950 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1337/2692] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:38:25.939583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924806ca-6fa7-497a-9d1b-fe0930b4a572 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:25.941522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-924806ca-6fa7-497a-9d1b-fe0930b4a572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:25.978701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:26.006194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924806ca-6fa7-497a-9d1b-fe0930b4a572 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:26.010428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8e0f1-a3ad-4bfd-bf89-4d2dae38acae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:26.011082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e0f1-a3ad-4bfd-bf89-4d2dae38acae service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:26.011365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e0f1-a3ad-4bfd-bf89-4d2dae38acae service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:26.011731 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e0f1-a3ad-4bfd-bf89-4d2dae38acae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:26.073574 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8e0f1-a3ad-4bfd-bf89-4d2dae38acae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:26.074934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8e0f1-a3ad-4bfd-bf89-4d2dae38acae service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:26.093215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1356/2693] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:38:27.602626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822e310-0a0d-43a6-854f-fa1264756ee6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:27.604900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6822e310-0a0d-43a6-854f-fa1264756ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:27.619090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822e310-0a0d-43a6-854f-fa1264756ee6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:27.623345 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b36506-ec76-4289-a3eb-064c913577f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:27.623997 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b36506-ec76-4289-a3eb-064c913577f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:27.624279 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b36506-ec76-4289-a3eb-064c913577f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:27.624554 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b36506-ec76-4289-a3eb-064c913577f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:27.685684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:27.697421 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b36506-ec76-4289-a3eb-064c913577f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:27.698870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b36506-ec76-4289-a3eb-064c913577f7 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:27.707747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1338/2694] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:28.257083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8e0f1-a3ad-4bfd-bf89-4d2dae38acae service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:28.265993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8e0f1-a3ad-4bfd-bf89-4d2dae38acae service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:28.269943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a1589-564b-4b8f-8793-fecd35af4747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:28.270603 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a1589-564b-4b8f-8793-fecd35af4747 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:28.270880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a1589-564b-4b8f-8793-fecd35af4747 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:28.271150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a1589-564b-4b8f-8793-fecd35af4747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:28.280852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a1589-564b-4b8f-8793-fecd35af4747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:28.282332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a1589-564b-4b8f-8793-fecd35af4747 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:28.292669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1357/2695] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:32.188538 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b36506-ec76-4289-a3eb-064c913577f7 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:32.254516 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b36506-ec76-4289-a3eb-064c913577f7 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:32.259934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:32.260806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:32.261125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:32.261396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] PATH_INFO: `/v3/users/42760e256054448e8ebb75df391568c2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:32.262661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42760e256054448e8ebb75df391568c2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:32.264605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:32.312980 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42760e256054448e8ebb75df391568c2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:32.324870 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42760e256054448e8ebb75df391568c2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:32.325555 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42760e256054448e8ebb75df391568c2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:32.326161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42760e256054448e8ebb75df391568c2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:32.334483 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42760e256054448e8ebb75df391568c2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:32.347102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1339/2696] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:38:32 2022] DELETE /identity/v3/users/42760e256054448e8ebb75df391568c2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:32.351734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf57b8-a7ac-404b-84a6-a719cdaf6b13 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:32.352228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf57b8-a7ac-404b-84a6-a719cdaf6b13 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:32.352323 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf57b8-a7ac-404b-84a6-a719cdaf6b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:32.370307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9eaf57b8-a7ac-404b-84a6-a719cdaf6b13 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:32.371519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9eaf57b8-a7ac-404b-84a6-a719cdaf6b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:32.433834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1358/2697] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:32.443741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:32.445456 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:32.504299 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8998f-f9f3-4edb-8e20-3999feda71c6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:32.508337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7699bfb-8159-4ff9-bc20-6ae2429eb40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:32.508990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7699bfb-8159-4ff9-bc20-6ae2429eb40a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:32.509302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7699bfb-8159-4ff9-bc20-6ae2429eb40a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:32.509580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7699bfb-8159-4ff9-bc20-6ae2429eb40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:32.518695 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7699bfb-8159-4ff9-bc20-6ae2429eb40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:32.520134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7699bfb-8159-4ff9-bc20-6ae2429eb40a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:32.529659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1340/2698] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:32.802595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf57b8-a7ac-404b-84a6-a719cdaf6b13 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:32.804079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9eaf57b8-a7ac-404b-84a6-a719cdaf6b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:32.830470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf57b8-a7ac-404b-84a6-a719cdaf6b13 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:32.835426 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:32.836259 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:32.836468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:32.836792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] PATH_INFO: `/v3/projects/66dbcf1a35b5411aa0f324813b84ee2c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:32.838019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66dbcf1a35b5411aa0f324813b84ee2c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:32.839963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:32.893940 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66dbcf1a35b5411aa0f324813b84ee2c', 'request_id': 'req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:32.902650 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66dbcf1a35b5411aa0f324813b84ee2c', 'request_id': 'req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:32.908427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66dbcf1a35b5411aa0f324813b84ee2c', 'request_id': 'req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:32.916002 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:32.920888 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] The token cache is being invalidate because project 66dbcf1a35b5411aa0f324813b84ee2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:38:32.922540 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:32.923350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:32.925776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1359/2699] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:38:32 2022] DELETE /identity/v3/projects/66dbcf1a35b5411aa0f324813b84ee2c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:32.930009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7699bfb-8159-4ff9-bc20-6ae2429eb40a service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:32.939716 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7699bfb-8159-4ff9-bc20-6ae2429eb40a service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:32.947900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:33.000248 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:33.001081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:33.001360 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:33.001631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] PATH_INFO: `/v3/users/9d2414030ab9474fb2d3184e6c8ef656` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:33.002803 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2414030ab9474fb2d3184e6c8ef656)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:33.004752 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:33.052084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2414030ab9474fb2d3184e6c8ef656'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.063577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2414030ab9474fb2d3184e6c8ef656'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.064240 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2414030ab9474fb2d3184e6c8ef656'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.064843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2414030ab9474fb2d3184e6c8ef656'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.074376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2414030ab9474fb2d3184e6c8ef656'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.087092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1341/2700] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:38:32 2022] DELETE /identity/v3/users/9d2414030ab9474fb2d3184e6c8ef656 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:33.369064 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:33.370825 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:33.384677 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cad77b-b7d4-4ffe-8e75-d5b8d710dc41 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:33.442580 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:33.443456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:33.443742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:33.444021 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] PATH_INFO: `/v3/projects/26ab98bcf8244a8c81c1c3ff79f3b497` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:33.445267 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ab98bcf8244a8c81c1c3ff79f3b497)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:33.447206 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:33.496605 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ab98bcf8244a8c81c1c3ff79f3b497', 'request_id': 'req-57a349ae-0c0a-464f-9800-47c807262a99'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.504458 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ab98bcf8244a8c81c1c3ff79f3b497', 'request_id': 'req-57a349ae-0c0a-464f-9800-47c807262a99'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.510788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ab98bcf8244a8c81c1c3ff79f3b497', 'request_id': 'req-57a349ae-0c0a-464f-9800-47c807262a99'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.523163 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] The token cache is being invalidate because project 26ab98bcf8244a8c81c1c3ff79f3b497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:38:33.523384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.524003 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.525660 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1360/2701] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:38:33 2022] DELETE /identity/v3/projects/26ab98bcf8244a8c81c1c3ff79f3b497 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:33.529983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:33.531607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:33.545101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4594a-19c1-4ed8-be4d-8aa05a4c93e7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:33.600829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31e484-7f61-4d4f-93fe-9d454d347a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:33.601738 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31e484-7f61-4d4f-93fe-9d454d347a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:33.601993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31e484-7f61-4d4f-93fe-9d454d347a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:33.602280 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31e484-7f61-4d4f-93fe-9d454d347a36 admin admin] PATH_INFO: `/v3/users/a0c4fa92d43a495d84321b7fb36fd19d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:33.603564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31e484-7f61-4d4f-93fe-9d454d347a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c4fa92d43a495d84321b7fb36fd19d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:33.605507 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31e484-7f61-4d4f-93fe-9d454d347a36 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:33.643763 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:33.657449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1c31e484-7f61-4d4f-93fe-9d454d347a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c4fa92d43a495d84321b7fb36fd19d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.669605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1c31e484-7f61-4d4f-93fe-9d454d347a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c4fa92d43a495d84321b7fb36fd19d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.670293 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1c31e484-7f61-4d4f-93fe-9d454d347a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c4fa92d43a495d84321b7fb36fd19d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.670956 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1c31e484-7f61-4d4f-93fe-9d454d347a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c4fa92d43a495d84321b7fb36fd19d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.680488 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1c31e484-7f61-4d4f-93fe-9d454d347a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c4fa92d43a495d84321b7fb36fd19d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:33.698413 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1342/2702] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:38:33 2022] DELETE /identity/v3/users/a0c4fa92d43a495d84321b7fb36fd19d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:33.982549 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:33.984445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:33.998804 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a349ae-0c0a-464f-9800-47c807262a99 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:34.063946 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:34.064735 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:34.065048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:34.065326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] PATH_INFO: `/v3/projects/3147e3d4483d401fbc0345de16b336c5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:34.066533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3147e3d4483d401fbc0345de16b336c5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:34.068524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:34.105971 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:34.122991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3147e3d4483d401fbc0345de16b336c5', 'request_id': 'req-dd0173c7-5088-44b5-b389-359d3546640a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:34.131270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3147e3d4483d401fbc0345de16b336c5', 'request_id': 'req-dd0173c7-5088-44b5-b389-359d3546640a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:34.137282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3147e3d4483d401fbc0345de16b336c5', 'request_id': 'req-dd0173c7-5088-44b5-b389-359d3546640a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:34.148782 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] The token cache is being invalidate because project 3147e3d4483d401fbc0345de16b336c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:38:34.149104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:34.149750 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-dd0173c7-5088-44b5-b389-359d3546640a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:34.151305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1361/2703] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:38:33 2022] DELETE /identity/v3/projects/3147e3d4483d401fbc0345de16b336c5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:34.156218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72f4d-b3cc-4727-aa61-45453e138eb0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:34.156508 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72f4d-b3cc-4727-aa61-45453e138eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:34.156784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72f4d-b3cc-4727-aa61-45453e138eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:34.175104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a7d72f4d-b3cc-4727-aa61-45453e138eb0 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:34.176336 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a7d72f4d-b3cc-4727-aa61-45453e138eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:34.238714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1343/2704] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:34.246821 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e473b-6492-4e12-97eb-3390df0db578 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:34.247104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e473b-6492-4e12-97eb-3390df0db578 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:34.247508 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e473b-6492-4e12-97eb-3390df0db578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:34.266956 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5f8e473b-6492-4e12-97eb-3390df0db578 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:34.268158 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5f8e473b-6492-4e12-97eb-3390df0db578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:34.276852 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1362/2705] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:38:34.280991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d72f4d-b3cc-4727-aa61-45453e138eb0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:34.290897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d72f4d-b3cc-4727-aa61-45453e138eb0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:34.295868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ee4f4-3ddc-439f-94d2-d4fb7a625013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:34.296525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ee4f4-3ddc-439f-94d2-d4fb7a625013 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:34.296829 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ee4f4-3ddc-439f-94d2-d4fb7a625013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:34.297139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ee4f4-3ddc-439f-94d2-d4fb7a625013 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:34.297869 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ee4f4-3ddc-439f-94d2-d4fb7a625013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:38:34.298203 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ee4f4-3ddc-439f-94d2-d4fb7a625013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:34.299794 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ee4f4-3ddc-439f-94d2-d4fb7a625013 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:34.313007 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1344/2706] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:38:34.317759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e473b-6492-4e12-97eb-3390df0db578 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:34.327472 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e473b-6492-4e12-97eb-3390df0db578 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:34.332342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b5bf-2ede-45dc-bfdc-e1fcddb2748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:34.333019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b5bf-2ede-45dc-bfdc-e1fcddb2748e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:34.333301 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b5bf-2ede-45dc-bfdc-e1fcddb2748e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:34.333587 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b5bf-2ede-45dc-bfdc-e1fcddb2748e admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:34.334288 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b5bf-2ede-45dc-bfdc-e1fcddb2748e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:34.336321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b5bf-2ede-45dc-bfdc-e1fcddb2748e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:34.368764 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1363/2707] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:38:34 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:38:34.370205 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ee4f4-3ddc-439f-94d2-d4fb7a625013 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:34.381562 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ee4f4-3ddc-439f-94d2-d4fb7a625013 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:34.439549 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24b4d0-e854-4427-9241-be0e9c8863e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:34.440234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24b4d0-e854-4427-9241-be0e9c8863e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:34.440516 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24b4d0-e854-4427-9241-be0e9c8863e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:34.440791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24b4d0-e854-4427-9241-be0e9c8863e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:34.441527 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24b4d0-e854-4427-9241-be0e9c8863e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:34.443487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24b4d0-e854-4427-9241-be0e9c8863e0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:34.465158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1345/2708] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:38:34 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:38:34.469642 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b5bf-2ede-45dc-bfdc-e1fcddb2748e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:34.480295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b5bf-2ede-45dc-bfdc-e1fcddb2748e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:34.484916 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be22cf-6d79-4872-9937-38b52ab17992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:34.485621 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be22cf-6d79-4872-9937-38b52ab17992 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:34.485901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be22cf-6d79-4872-9937-38b52ab17992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:34.486171 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be22cf-6d79-4872-9937-38b52ab17992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:34.486907 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be22cf-6d79-4872-9937-38b52ab17992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:34.488504 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be22cf-6d79-4872-9937-38b52ab17992 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:34.499308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1364/2709] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:38:34.503415 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24b4d0-e854-4427-9241-be0e9c8863e0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:34.514069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24b4d0-e854-4427-9241-be0e9c8863e0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:34.518768 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41723c52-02ff-4ec2-8cb8-8f0dc8899463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:34.519449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41723c52-02ff-4ec2-8cb8-8f0dc8899463 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:34.519735 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41723c52-02ff-4ec2-8cb8-8f0dc8899463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:34.520041 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41723c52-02ff-4ec2-8cb8-8f0dc8899463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:34.520815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41723c52-02ff-4ec2-8cb8-8f0dc8899463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:34.522454 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41723c52-02ff-4ec2-8cb8-8f0dc8899463 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:34.533224 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1346/2710] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:38:34.537701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be22cf-6d79-4872-9937-38b52ab17992 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:34.549157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be22cf-6d79-4872-9937-38b52ab17992 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:34.560422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7ed46-93a1-492b-845d-71914b60afde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:34.561363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ed46-93a1-492b-845d-71914b60afde admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:34.561698 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ed46-93a1-492b-845d-71914b60afde admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:34.561975 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ed46-93a1-492b-845d-71914b60afde admin admin] PATH_INFO: `/v3/projects/6bb4f5ecc68944dc891c1f83c8060dce/users/6cf0fdc1f64c4df0a4fd7426981ec859/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:34.577563 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7ed46-93a1-492b-845d-71914b60afde admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb4f5ecc68944dc891c1f83c8060dce, user_id=6cf0fdc1f64c4df0a4fd7426981ec859, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:34.580099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7ed46-93a1-492b-845d-71914b60afde admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:34.594942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1365/2711] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:38:34 2022] PUT /identity/v3/projects/6bb4f5ecc68944dc891c1f83c8060dce/users/6cf0fdc1f64c4df0a4fd7426981ec859/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:34.600178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713bac-5115-4c30-b6bd-d590019eca76 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:34.600465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713bac-5115-4c30-b6bd-d590019eca76 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:34.600740 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713bac-5115-4c30-b6bd-d590019eca76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:34.620891 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d8713bac-5115-4c30-b6bd-d590019eca76 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:34.622239 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d8713bac-5115-4c30-b6bd-d590019eca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:34.632297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:34.686358 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1347/2712] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:34.696500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7ed46-93a1-492b-845d-71914b60afde admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:34.698307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6be7ed46-93a1-492b-845d-71914b60afde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:34.754962 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7ed46-93a1-492b-845d-71914b60afde admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:34.758604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de3c2-b229-400a-b0dc-a9a5802a9d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:34.759255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de3c2-b229-400a-b0dc-a9a5802a9d3c service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:34.759531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de3c2-b229-400a-b0dc-a9a5802a9d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:34.759798 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de3c2-b229-400a-b0dc-a9a5802a9d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:34.769363 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623de3c2-b229-400a-b0dc-a9a5802a9d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:34.770858 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623de3c2-b229-400a-b0dc-a9a5802a9d3c service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:34.780320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1366/2713] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:35.410536 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153e873-fdc3-43c5-811d-f58e3278d584 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:35.410868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153e873-fdc3-43c5-811d-f58e3278d584 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:35.411149 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153e873-fdc3-43c5-811d-f58e3278d584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:35.437842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6153e873-fdc3-43c5-811d-f58e3278d584 None None] MFA Rules not processed for user `6cf0fdc1f64c4df0a4fd7426981ec859`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:35.439186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6153e873-fdc3-43c5-811d-f58e3278d584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:35.507750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1348/2714] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:35.518572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de3c2-b229-400a-b0dc-a9a5802a9d3c service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:35.520175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-623de3c2-b229-400a-b0dc-a9a5802a9d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:35.579309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de3c2-b229-400a-b0dc-a9a5802a9d3c service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:35.583083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68757b4-e074-4f76-a5f5-3f6041ee3f58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:35.583755 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68757b4-e074-4f76-a5f5-3f6041ee3f58 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:35.584036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68757b4-e074-4f76-a5f5-3f6041ee3f58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:35.584371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68757b4-e074-4f76-a5f5-3f6041ee3f58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:35.593479 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68757b4-e074-4f76-a5f5-3f6041ee3f58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:35.594947 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68757b4-e074-4f76-a5f5-3f6041ee3f58 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:35.599614 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:35.605037 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1367/2715] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:36.975193 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4799f-7dbb-42d8-ad61-efb4bbf71329 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:36.975610 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4799f-7dbb-42d8-ad61-efb4bbf71329 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:36.975831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4799f-7dbb-42d8-ad61-efb4bbf71329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:36.993913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-68d4799f-7dbb-42d8-ad61-efb4bbf71329 None None] MFA Rules not processed for user `6cf0fdc1f64c4df0a4fd7426981ec859`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:36.995131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-68d4799f-7dbb-42d8-ad61-efb4bbf71329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:37.005913 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1349/2716] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:39.276686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68757b4-e074-4f76-a5f5-3f6041ee3f58 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:39.293449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68757b4-e074-4f76-a5f5-3f6041ee3f58 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:39.297148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c816f6-91ea-4928-ae4d-319020040715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:39.297867 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c816f6-91ea-4928-ae4d-319020040715 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:39.298225 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c816f6-91ea-4928-ae4d-319020040715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:39.298494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c816f6-91ea-4928-ae4d-319020040715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:39.302638 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-24c816f6-91ea-4928-ae4d-319020040715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:39.386053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c816f6-91ea-4928-ae4d-319020040715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:39.387391 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c816f6-91ea-4928-ae4d-319020040715 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:39.399701 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1368/2717] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:46.988300 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=55 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:49.394120 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=30 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:49.695943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b71f0-f407-4de0-9f32-2fd2821b5bad None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:49.696414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b71f0-f407-4de0-9f32-2fd2821b5bad None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:49.696525 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b71f0-f407-4de0-9f32-2fd2821b5bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:49.714037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-242b71f0-f407-4de0-9f32-2fd2821b5bad None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:49.715251 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-242b71f0-f407-4de0-9f32-2fd2821b5bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:49.770453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1350/2718] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jul 6 20:38:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:49.820443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c816f6-91ea-4928-ae4d-319020040715 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:49.822387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-24c816f6-91ea-4928-ae4d-319020040715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:49.894788 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c816f6-91ea-4928-ae4d-319020040715 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:49.900658 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687a31-8dcc-4bd9-aa13-6486803a6090 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:49.901357 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687a31-8dcc-4bd9-aa13-6486803a6090 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:49.901635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687a31-8dcc-4bd9-aa13-6486803a6090 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:49.901901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687a31-8dcc-4bd9-aa13-6486803a6090 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:49.910429 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687a31-8dcc-4bd9-aa13-6486803a6090 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:49.912005 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687a31-8dcc-4bd9-aa13-6486803a6090 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:49.920321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1369/2719] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:38:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:38:53.129663 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96317dbc-40cf-49b4-938e-23ef3ca2d382 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:53.130517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96317dbc-40cf-49b4-938e-23ef3ca2d382 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:53.130984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96317dbc-40cf-49b4-938e-23ef3ca2d382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:53.149605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-96317dbc-40cf-49b4-938e-23ef3ca2d382 None None] MFA Rules not processed for user `6cf0fdc1f64c4df0a4fd7426981ec859`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:38:53.150838 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-96317dbc-40cf-49b4-938e-23ef3ca2d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:53.158448 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1351/2720] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:38:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:38:57.966790 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687a31-8dcc-4bd9-aa13-6486803a6090 service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:57.969967 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ce687a31-8dcc-4bd9-aa13-6486803a6090 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:58.038118 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96317dbc-40cf-49b4-938e-23ef3ca2d382 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:58.040281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-96317dbc-40cf-49b4-938e-23ef3ca2d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:58.058570 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687a31-8dcc-4bd9-aa13-6486803a6090 service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:58.063793 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62577-db0e-4383-97e4-48312ad2faa1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df36a267464042908bbd8eebc7c40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:58.064535 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62577-db0e-4383-97e4-48312ad2faa1 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:58.064886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62577-db0e-4383-97e4-48312ad2faa1 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:58.065262 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62577-db0e-4383-97e4-48312ad2faa1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:58.067157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-35c62577-db0e-4383-97e4-48312ad2faa1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:58.081578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c62577-db0e-4383-97e4-48312ad2faa1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:58.083215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c62577-db0e-4383-97e4-48312ad2faa1 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:58.096305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1370/2721] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:38:58.097415 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62577-db0e-4383-97e4-48312ad2faa1 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:58.099338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-35c62577-db0e-4383-97e4-48312ad2faa1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:58.119489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62577-db0e-4383-97e4-48312ad2faa1 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:58.124571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96317dbc-40cf-49b4-938e-23ef3ca2d382 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:58.126008 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:58.127943 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:58.128536 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:58.129131 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] PATH_INFO: `/v3/users/31306b56242f4761980cec667e783af1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:58.129954 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df207df-7b60-4e44-81a5-e4c4ec278414 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df36a267464042908bbd8eebc7c40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:58.130800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df207df-7b60-4e44-81a5-e4c4ec278414 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:58.131071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31306b56242f4761980cec667e783af1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:58.131194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df207df-7b60-4e44-81a5-e4c4ec278414 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:58.131347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df207df-7b60-4e44-81a5-e4c4ec278414 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:58.133392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9df207df-7b60-4e44-81a5-e4c4ec278414 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:58.133988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:58.145434 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df207df-7b60-4e44-81a5-e4c4ec278414 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:58.147041 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df207df-7b60-4e44-81a5-e4c4ec278414 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:58.158086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1352/2722] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:38:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:38:58.185137 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31306b56242f4761980cec667e783af1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.199246 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31306b56242f4761980cec667e783af1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.199959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31306b56242f4761980cec667e783af1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.208759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31306b56242f4761980cec667e783af1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.210925 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:58.217147 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31306b56242f4761980cec667e783af1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.224159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1371/2723] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:38:58 2022] DELETE /identity/v3/users/31306b56242f4761980cec667e783af1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:58.416690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df207df-7b60-4e44-81a5-e4c4ec278414 service placement] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:58.430576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df207df-7b60-4e44-81a5-e4c4ec278414 service placement] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:58.491466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:58.492394 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:58.492676 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:58.492945 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] PATH_INFO: `/v3/projects/93a996db48a34eaf9692c0e92414c2b4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:58.494234 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a996db48a34eaf9692c0e92414c2b4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:58.496183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:58.531302 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:38:58.545314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a996db48a34eaf9692c0e92414c2b4', 'request_id': 'req-4af13e8a-3150-45b0-b300-b59fb25914f5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.553102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a996db48a34eaf9692c0e92414c2b4', 'request_id': 'req-4af13e8a-3150-45b0-b300-b59fb25914f5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.558582 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a996db48a34eaf9692c0e92414c2b4', 'request_id': 'req-4af13e8a-3150-45b0-b300-b59fb25914f5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.570103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] The token cache is being invalidate because project 93a996db48a34eaf9692c0e92414c2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:38:58.570386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.571214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.572854 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1353/2724] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:38:58 2022] DELETE /identity/v3/projects/93a996db48a34eaf9692c0e92414c2b4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:58.576979 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:58.578431 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:58.592404 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a7e59-fb8f-4198-9fe7-f555eedaa1d0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:58.651157 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ace06-7879-48b3-b47d-89a84b3d3bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:58.652099 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ace06-7879-48b3-b47d-89a84b3d3bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:58.652368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ace06-7879-48b3-b47d-89a84b3d3bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:58.652988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ace06-7879-48b3-b47d-89a84b3d3bdb admin admin] PATH_INFO: `/v3/users/abc07a8316ad4343ab80a09bd5f3ccb9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:58.654222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ace06-7879-48b3-b47d-89a84b3d3bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc07a8316ad4343ab80a09bd5f3ccb9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:58.656173 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ace06-7879-48b3-b47d-89a84b3d3bdb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:58.709370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b05ace06-7879-48b3-b47d-89a84b3d3bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc07a8316ad4343ab80a09bd5f3ccb9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.723873 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b05ace06-7879-48b3-b47d-89a84b3d3bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc07a8316ad4343ab80a09bd5f3ccb9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.724659 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b05ace06-7879-48b3-b47d-89a84b3d3bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc07a8316ad4343ab80a09bd5f3ccb9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.733895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b05ace06-7879-48b3-b47d-89a84b3d3bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc07a8316ad4343ab80a09bd5f3ccb9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.741344 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b05ace06-7879-48b3-b47d-89a84b3d3bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc07a8316ad4343ab80a09bd5f3ccb9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:58.747443 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1372/2725] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:38:58 2022] DELETE /identity/v3/users/abc07a8316ad4343ab80a09bd5f3ccb9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:38:58.922786 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:38:58.924262 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:38:58.945681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af13e8a-3150-45b0-b300-b59fb25914f5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:38:59.003006 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:38:59.003879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:38:59.004157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:38:59.004427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] PATH_INFO: `/v3/projects/1246eb35c5414d1c96a2928aee02f027` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:38:59.005672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1246eb35c5414d1c96a2928aee02f027)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:38:59.007714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:38:59.059934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1246eb35c5414d1c96a2928aee02f027', 'request_id': 'req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:59.068739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1246eb35c5414d1c96a2928aee02f027', 'request_id': 'req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:59.075362 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1246eb35c5414d1c96a2928aee02f027', 'request_id': 'req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:59.088560 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] The token cache is being invalidate because project 1246eb35c5414d1c96a2928aee02f027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:38:59.088842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:59.089520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:38:59.091887 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1354/2726] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:38:58 2022] DELETE /identity/v3/projects/1246eb35c5414d1c96a2928aee02f027 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:39:08.743816 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:39:09.084572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=64,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:39:14.687746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e255d-7e7d-47f2-b9cb-d6349fc1b9b6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:14.688270 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e255d-7e7d-47f2-b9cb-d6349fc1b9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:14.688370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e255d-7e7d-47f2-b9cb-d6349fc1b9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:14.717261 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b89e255d-7e7d-47f2-b9cb-d6349fc1b9b6 None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:14.718497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b89e255d-7e7d-47f2-b9cb-d6349fc1b9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:14.775382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1373/2727] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:39:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:14.788850 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:14.790482 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:14.874002 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e17b7-1059-49e2-9aaf-f1cd401fa3f2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:14.879143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb6d6b-f167-477d-bfc3-00ae3912614f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:14.879793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb6d6b-f167-477d-bfc3-00ae3912614f service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:14.880073 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb6d6b-f167-477d-bfc3-00ae3912614f service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:14.880346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb6d6b-f167-477d-bfc3-00ae3912614f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:14.888451 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb6d6b-f167-477d-bfc3-00ae3912614f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:14.890142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb6d6b-f167-477d-bfc3-00ae3912614f service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:14.898841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1355/2728] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:39:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:39:17.780136 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2185ed-bf6b-4d31-9bf0-45eb8e2150d3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:17.780637 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2185ed-bf6b-4d31-9bf0-45eb8e2150d3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:17.780753 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2185ed-bf6b-4d31-9bf0-45eb8e2150d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:17.801702 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-eb2185ed-bf6b-4d31-9bf0-45eb8e2150d3 None None] MFA Rules not processed for user `b377f2751fa2446597aa6871650ec2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:17.803539 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eb2185ed-bf6b-4d31-9bf0-45eb8e2150d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:17.876019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1374/2729] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:39:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:24.895574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=32 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:39:27.866491 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=50 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:39:30.304096 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2f69b-af26-416e-a131-f90c0d8df53e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:30.304607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2f69b-af26-416e-a131-f90c0d8df53e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:30.304717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2f69b-af26-416e-a131-f90c0d8df53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:30.322896 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-00a2f69b-af26-416e-a131-f90c0d8df53e None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:30.324115 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-00a2f69b-af26-416e-a131-f90c0d8df53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:30.331751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1356/2730] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jul 6 20:39:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:30.344801 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2185ed-bf6b-4d31-9bf0-45eb8e2150d3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:30.356713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2185ed-bf6b-4d31-9bf0-45eb8e2150d3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:30.362019 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abc876-5cf1-4590-9cb0-0bbeff7079be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:30.362771 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc876-5cf1-4590-9cb0-0bbeff7079be service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:30.363051 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc876-5cf1-4590-9cb0-0bbeff7079be service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:30.363326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc876-5cf1-4590-9cb0-0bbeff7079be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:30.372407 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abc876-5cf1-4590-9cb0-0bbeff7079be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:30.374820 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abc876-5cf1-4590-9cb0-0bbeff7079be service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:30.384652 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1375/2731] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:39:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:39:32.404286 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2f69b-af26-416e-a131-f90c0d8df53e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:32.405790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-00a2f69b-af26-416e-a131-f90c0d8df53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:32.473659 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2f69b-af26-416e-a131-f90c0d8df53e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:32.478364 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05d305-d85b-4716-a537-9b6bf75f02eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:32.479266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05d305-d85b-4716-a537-9b6bf75f02eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:32.479535 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05d305-d85b-4716-a537-9b6bf75f02eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:32.479803 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05d305-d85b-4716-a537-9b6bf75f02eb admin admin] PATH_INFO: `/v3/users/6cf0fdc1f64c4df0a4fd7426981ec859` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:32.481520 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05d305-d85b-4716-a537-9b6bf75f02eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf0fdc1f64c4df0a4fd7426981ec859)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:32.482960 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05d305-d85b-4716-a537-9b6bf75f02eb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:32.531774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-df05d305-d85b-4716-a537-9b6bf75f02eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf0fdc1f64c4df0a4fd7426981ec859'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:39:32.544773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-df05d305-d85b-4716-a537-9b6bf75f02eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf0fdc1f64c4df0a4fd7426981ec859'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:39:32.545556 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-df05d305-d85b-4716-a537-9b6bf75f02eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf0fdc1f64c4df0a4fd7426981ec859'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:39:32.546228 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-df05d305-d85b-4716-a537-9b6bf75f02eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf0fdc1f64c4df0a4fd7426981ec859'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:39:32.554918 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-df05d305-d85b-4716-a537-9b6bf75f02eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf0fdc1f64c4df0a4fd7426981ec859'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:39:32.568051 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1357/2732] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:39:32 2022] DELETE /identity/v3/users/6cf0fdc1f64c4df0a4fd7426981ec859 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:39:32.749203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abc876-5cf1-4590-9cb0-0bbeff7079be service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:32.760149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abc876-5cf1-4590-9cb0-0bbeff7079be service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:32.820611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:32.821568 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:32.821854 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:32.822132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] PATH_INFO: `/v3/projects/6bb4f5ecc68944dc891c1f83c8060dce` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:32.823325 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bb4f5ecc68944dc891c1f83c8060dce)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:32.825275 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:32.874254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bb4f5ecc68944dc891c1f83c8060dce', 'request_id': 'req-61383d7c-dbae-4c4e-88a5-87f92418c7ab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:39:32.882364 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bb4f5ecc68944dc891c1f83c8060dce', 'request_id': 'req-61383d7c-dbae-4c4e-88a5-87f92418c7ab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:39:32.888222 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bb4f5ecc68944dc891c1f83c8060dce', 'request_id': 'req-61383d7c-dbae-4c4e-88a5-87f92418c7ab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:39:32.901490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] The token cache is being invalidate because project 6bb4f5ecc68944dc891c1f83c8060dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:39:32.901838 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:39:32.902562 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61383d7c-dbae-4c4e-88a5-87f92418c7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:39:32.904149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1376/2733] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:39:32 2022] DELETE /identity/v3/projects/6bb4f5ecc68944dc891c1f83c8060dce => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:39:32.909675 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48959dc-a2b6-4277-be1f-6338adfbd081 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:32.909962 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48959dc-a2b6-4277-be1f-6338adfbd081 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:32.910242 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48959dc-a2b6-4277-be1f-6338adfbd081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:32.929207 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d48959dc-a2b6-4277-be1f-6338adfbd081 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:32.930430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d48959dc-a2b6-4277-be1f-6338adfbd081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:32.990511 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1358/2734] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:32.998682 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddde5e-b5a7-4339-a3de-e600dbecbf5b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:32.998972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddde5e-b5a7-4339-a3de-e600dbecbf5b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:32.999249 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddde5e-b5a7-4339-a3de-e600dbecbf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:33.017744 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8eddde5e-b5a7-4339-a3de-e600dbecbf5b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:33.018942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8eddde5e-b5a7-4339-a3de-e600dbecbf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:33.027399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1377/2735] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:33.031672 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48959dc-a2b6-4277-be1f-6338adfbd081 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:33.041830 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48959dc-a2b6-4277-be1f-6338adfbd081 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:33.046824 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b53c30-cc6f-4413-aea5-e75500f16dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:33.047492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53c30-cc6f-4413-aea5-e75500f16dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:33.047766 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53c30-cc6f-4413-aea5-e75500f16dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:33.048053 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53c30-cc6f-4413-aea5-e75500f16dbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:33.048784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b53c30-cc6f-4413-aea5-e75500f16dbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:39:33.049127 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b53c30-cc6f-4413-aea5-e75500f16dbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:33.050733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b53c30-cc6f-4413-aea5-e75500f16dbd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:33.059449 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:39:33.063188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1359/2736] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:39:33.068305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddde5e-b5a7-4339-a3de-e600dbecbf5b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:33.077776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddde5e-b5a7-4339-a3de-e600dbecbf5b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:33.082694 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599e15c-4e30-4818-ba50-224114030edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:33.083386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599e15c-4e30-4818-ba50-224114030edf admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:33.083689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599e15c-4e30-4818-ba50-224114030edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:33.083960 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599e15c-4e30-4818-ba50-224114030edf admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:33.084686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599e15c-4e30-4818-ba50-224114030edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:33.086647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599e15c-4e30-4818-ba50-224114030edf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:33.114368 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1378/2737] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:39:33 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:39:33.118796 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b53c30-cc6f-4413-aea5-e75500f16dbd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:33.128926 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b53c30-cc6f-4413-aea5-e75500f16dbd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:33.188113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dde8cc-10e0-4282-a3b5-cf2e086f1660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:33.188777 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dde8cc-10e0-4282-a3b5-cf2e086f1660 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:33.189095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dde8cc-10e0-4282-a3b5-cf2e086f1660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:33.189368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dde8cc-10e0-4282-a3b5-cf2e086f1660 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:33.190067 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dde8cc-10e0-4282-a3b5-cf2e086f1660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:33.191991 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dde8cc-10e0-4282-a3b5-cf2e086f1660 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:33.213400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1360/2738] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:39:33 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:39:33.218179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599e15c-4e30-4818-ba50-224114030edf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:33.232074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599e15c-4e30-4818-ba50-224114030edf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:33.237572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdc12f-da13-472f-b187-29a846e42d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:33.238272 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc12f-da13-472f-b187-29a846e42d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:33.238552 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc12f-da13-472f-b187-29a846e42d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:33.238823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc12f-da13-472f-b187-29a846e42d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:33.239561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdc12f-da13-472f-b187-29a846e42d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:33.241230 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdc12f-da13-472f-b187-29a846e42d8c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:33.252194 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1379/2739] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:39:33.256305 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dde8cc-10e0-4282-a3b5-cf2e086f1660 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:33.266641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dde8cc-10e0-4282-a3b5-cf2e086f1660 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:33.272101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24f203-455c-42d4-8b41-b8902fb01de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:33.272730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f203-455c-42d4-8b41-b8902fb01de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:33.273162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f203-455c-42d4-8b41-b8902fb01de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:33.273406 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f203-455c-42d4-8b41-b8902fb01de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:33.274137 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24f203-455c-42d4-8b41-b8902fb01de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:33.275712 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24f203-455c-42d4-8b41-b8902fb01de5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:33.286616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1361/2740] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:39:33.290910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdc12f-da13-472f-b187-29a846e42d8c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:33.301352 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdc12f-da13-472f-b187-29a846e42d8c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:33.307160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0157b1-6397-4a23-a396-81a26cfeb936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:33.308049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0157b1-6397-4a23-a396-81a26cfeb936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:33.308324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0157b1-6397-4a23-a396-81a26cfeb936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:33.308598 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0157b1-6397-4a23-a396-81a26cfeb936 admin admin] PATH_INFO: `/v3/projects/63803f26217a40ad992309faa5322439/users/f0efccb9d0444bbebb127cb76c15efff/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:33.324065 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0157b1-6397-4a23-a396-81a26cfeb936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63803f26217a40ad992309faa5322439, user_id=f0efccb9d0444bbebb127cb76c15efff, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:33.326769 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0157b1-6397-4a23-a396-81a26cfeb936 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:33.343524 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1380/2741] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:39:33 2022] PUT /identity/v3/projects/63803f26217a40ad992309faa5322439/users/f0efccb9d0444bbebb127cb76c15efff/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:39:33.354183 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd07597-13fd-4be9-ba37-2aa421f5fbeb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:33.354473 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd07597-13fd-4be9-ba37-2aa421f5fbeb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:33.354752 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd07597-13fd-4be9-ba37-2aa421f5fbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:33.383213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3cd07597-13fd-4be9-ba37-2aa421f5fbeb None None] MFA Rules not processed for user `f0efccb9d0444bbebb127cb76c15efff`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:33.384470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3cd07597-13fd-4be9-ba37-2aa421f5fbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:33.453251 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1362/2742] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:39:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:33.465765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0157b1-6397-4a23-a396-81a26cfeb936 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:33.467837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5e0157b1-6397-4a23-a396-81a26cfeb936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:33.483125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:39:33.529759 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0157b1-6397-4a23-a396-81a26cfeb936 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:33.533500 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad62ea5-e732-49ec-abf7-3d3048bf0ac7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f53619b6994ae0a117549a67fa29a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:33.534159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad62ea5-e732-49ec-abf7-3d3048bf0ac7 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:33.534470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad62ea5-e732-49ec-abf7-3d3048bf0ac7 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:33.534744 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad62ea5-e732-49ec-abf7-3d3048bf0ac7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:33.543461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad62ea5-e732-49ec-abf7-3d3048bf0ac7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:33.544918 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad62ea5-e732-49ec-abf7-3d3048bf0ac7 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:33.554033 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1381/2743] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:39:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:39:43.449930 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:39:43.550061 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=20 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:40:04.963790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd07597-13fd-4be9-ba37-2aa421f5fbeb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:05.033863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd07597-13fd-4be9-ba37-2aa421f5fbeb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:05.039470 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:05.040369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:05.040641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:05.040908 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] PATH_INFO: `/v3/users/f0efccb9d0444bbebb127cb76c15efff` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:05.042162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0efccb9d0444bbebb127cb76c15efff)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:05.044109 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:05.096395 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0efccb9d0444bbebb127cb76c15efff'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:05.110065 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0efccb9d0444bbebb127cb76c15efff'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:05.110717 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0efccb9d0444bbebb127cb76c15efff'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:05.111307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0efccb9d0444bbebb127cb76c15efff'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:05.121852 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0efccb9d0444bbebb127cb76c15efff'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:05.134578 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1363/2744] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:40:04 2022] DELETE /identity/v3/users/f0efccb9d0444bbebb127cb76c15efff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:40:05.139337 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ff29d-1ef8-4994-9875-b56488b7b849 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:05.139872 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ff29d-1ef8-4994-9875-b56488b7b849 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:05.139980 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ff29d-1ef8-4994-9875-b56488b7b849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:05.156878 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-414ff29d-1ef8-4994-9875-b56488b7b849 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:40:05.158101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-414ff29d-1ef8-4994-9875-b56488b7b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:05.220292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1382/2745] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:40:05.232326 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:05.233866 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:05.292939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60c4b4-af14-45a3-8212-27a31ea865db admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:05.297000 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6dccd-8a02-4c4d-8e54-70c4a6f6b3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:05.297641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6dccd-8a02-4c4d-8e54-70c4a6f6b3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:05.297940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6dccd-8a02-4c4d-8e54-70c4a6f6b3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:05.298196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6dccd-8a02-4c4d-8e54-70c4a6f6b3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:05.307342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6dccd-8a02-4c4d-8e54-70c4a6f6b3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:05.308759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6dccd-8a02-4c4d-8e54-70c4a6f6b3d5 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:05.318247 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1364/2746] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:40:05.604995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ff29d-1ef8-4994-9875-b56488b7b849 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:05.606569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-414ff29d-1ef8-4994-9875-b56488b7b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:05.619295 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ff29d-1ef8-4994-9875-b56488b7b849 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:05.624574 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:05.625532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:05.625817 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:05.626098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] PATH_INFO: `/v3/projects/63803f26217a40ad992309faa5322439` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:05.627315 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63803f26217a40ad992309faa5322439)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:05.629238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:05.677383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63803f26217a40ad992309faa5322439', 'request_id': 'req-547b26f3-8204-4348-a468-86c30ec4d470'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:05.686141 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63803f26217a40ad992309faa5322439', 'request_id': 'req-547b26f3-8204-4348-a468-86c30ec4d470'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:05.692094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63803f26217a40ad992309faa5322439', 'request_id': 'req-547b26f3-8204-4348-a468-86c30ec4d470'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:05.704485 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] The token cache is being invalidate because project 63803f26217a40ad992309faa5322439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:40:05.704799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:05.705577 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-547b26f3-8204-4348-a468-86c30ec4d470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:05.707226 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1383/2747] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:40:05 2022] DELETE /identity/v3/projects/63803f26217a40ad992309faa5322439 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:40:05.712606 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309b77f-d519-49ef-abaa-4cd90ac6dfba None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:05.712897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309b77f-d519-49ef-abaa-4cd90ac6dfba None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:05.713237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309b77f-d519-49ef-abaa-4cd90ac6dfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:05.731281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e309b77f-d519-49ef-abaa-4cd90ac6dfba None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:40:05.732504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e309b77f-d519-49ef-abaa-4cd90ac6dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:05.749996 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:40:05.793164 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1365/2748] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:40:05.802221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccb1a3-9a4c-47ce-9b60-3d5853cf950e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:05.802561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccb1a3-9a4c-47ce-9b60-3d5853cf950e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:05.802845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccb1a3-9a4c-47ce-9b60-3d5853cf950e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:05.828518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-72ccb1a3-9a4c-47ce-9b60-3d5853cf950e None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:40:05.829754 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-72ccb1a3-9a4c-47ce-9b60-3d5853cf950e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:05.839078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1384/2749] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:40:05.843624 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309b77f-d519-49ef-abaa-4cd90ac6dfba None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:05.853778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309b77f-d519-49ef-abaa-4cd90ac6dfba None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:05.859341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf2bb4-6712-4f01-b5bb-b5826de1c643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:05.860052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf2bb4-6712-4f01-b5bb-b5826de1c643 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:05.860330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf2bb4-6712-4f01-b5bb-b5826de1c643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:05.860633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf2bb4-6712-4f01-b5bb-b5826de1c643 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:05.861440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf2bb4-6712-4f01-b5bb-b5826de1c643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:40:05.861728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf2bb4-6712-4f01-b5bb-b5826de1c643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:05.863378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf2bb4-6712-4f01-b5bb-b5826de1c643 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:05.875609 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1366/2750] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:40:05.879930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccb1a3-9a4c-47ce-9b60-3d5853cf950e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:05.889361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccb1a3-9a4c-47ce-9b60-3d5853cf950e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:05.895233 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becfc11-8ae2-44a4-938b-6882df3f0d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:05.895889 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becfc11-8ae2-44a4-938b-6882df3f0d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:05.896155 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becfc11-8ae2-44a4-938b-6882df3f0d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:05.896422 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becfc11-8ae2-44a4-938b-6882df3f0d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:05.897185 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becfc11-8ae2-44a4-938b-6882df3f0d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:05.899073 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becfc11-8ae2-44a4-938b-6882df3f0d0a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:05.928742 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1385/2751] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:40:05 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:40:05.933130 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf2bb4-6712-4f01-b5bb-b5826de1c643 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:05.943523 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf2bb4-6712-4f01-b5bb-b5826de1c643 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:05.999386 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182af0f-0d08-4750-8e13-46400a195fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:06.000042 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182af0f-0d08-4750-8e13-46400a195fdb admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:06.000330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182af0f-0d08-4750-8e13-46400a195fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:06.000743 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182af0f-0d08-4750-8e13-46400a195fdb admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:06.002033 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182af0f-0d08-4750-8e13-46400a195fdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:06.005251 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182af0f-0d08-4750-8e13-46400a195fdb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:06.032045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1367/2752] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:40:05 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:40:06.036427 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becfc11-8ae2-44a4-938b-6882df3f0d0a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:06.046561 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becfc11-8ae2-44a4-938b-6882df3f0d0a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:06.052210 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05b0eb-9fb8-46d5-a9ce-ce02a14cdc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:06.052885 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05b0eb-9fb8-46d5-a9ce-ce02a14cdc76 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:06.053197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05b0eb-9fb8-46d5-a9ce-ce02a14cdc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:06.053468 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05b0eb-9fb8-46d5-a9ce-ce02a14cdc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:06.054215 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05b0eb-9fb8-46d5-a9ce-ce02a14cdc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:06.055844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05b0eb-9fb8-46d5-a9ce-ce02a14cdc76 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:06.066783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1386/2753] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:40:06.070730 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182af0f-0d08-4750-8e13-46400a195fdb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:06.081144 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182af0f-0d08-4750-8e13-46400a195fdb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:06.087095 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd445e-7b66-4785-a107-e72e7e8c7889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:06.087757 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd445e-7b66-4785-a107-e72e7e8c7889 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:06.088037 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd445e-7b66-4785-a107-e72e7e8c7889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:06.088307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd445e-7b66-4785-a107-e72e7e8c7889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:06.089092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd445e-7b66-4785-a107-e72e7e8c7889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:06.090701 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd445e-7b66-4785-a107-e72e7e8c7889 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:06.101113 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1368/2754] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:40:06.105305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05b0eb-9fb8-46d5-a9ce-ce02a14cdc76 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:06.116286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05b0eb-9fb8-46d5-a9ce-ce02a14cdc76 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:06.121624 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b4267-077d-4f91-829d-acb2939d859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:06.122495 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b4267-077d-4f91-829d-acb2939d859c admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:06.122776 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b4267-077d-4f91-829d-acb2939d859c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:06.123048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b4267-077d-4f91-829d-acb2939d859c admin admin] PATH_INFO: `/v3/projects/8f39828d2bcf4016be990bca2f111f7a/users/2c9c99e70fef461aaaf238a84227f993/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:06.139153 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b4267-077d-4f91-829d-acb2939d859c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f39828d2bcf4016be990bca2f111f7a, user_id=2c9c99e70fef461aaaf238a84227f993, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:06.141837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b4267-077d-4f91-829d-acb2939d859c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:06.157123 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1387/2755] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:40:06 2022] PUT /identity/v3/projects/8f39828d2bcf4016be990bca2f111f7a/users/2c9c99e70fef461aaaf238a84227f993/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:40:06.167640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693bf06-03b6-4595-83c6-a66c6e6ee71a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:06.167948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693bf06-03b6-4595-83c6-a66c6e6ee71a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:06.168225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693bf06-03b6-4595-83c6-a66c6e6ee71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:06.196048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c693bf06-03b6-4595-83c6-a66c6e6ee71a None None] MFA Rules not processed for user `2c9c99e70fef461aaaf238a84227f993`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:40:06.197202 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c693bf06-03b6-4595-83c6-a66c6e6ee71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:06.263463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1369/2756] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:40:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:40:06.275105 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b4267-077d-4f91-829d-acb2939d859c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:06.278145 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8b5b4267-077d-4f91-829d-acb2939d859c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:06.302446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:40:06.340345 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b4267-077d-4f91-829d-acb2939d859c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:06.344125 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1cf9a-afac-4a9e-ad7b-a594df99e219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:06.344780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1cf9a-afac-4a9e-ad7b-a594df99e219 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:06.345100 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1cf9a-afac-4a9e-ad7b-a594df99e219 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:06.345393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1cf9a-afac-4a9e-ad7b-a594df99e219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:06.354432 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1cf9a-afac-4a9e-ad7b-a594df99e219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:06.355875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1cf9a-afac-4a9e-ad7b-a594df99e219 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:06.364929 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1388/2757] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:40:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:40:07.754856 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ffee2-a6f6-4342-8dda-ba0daa580fe7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:07.755422 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ffee2-a6f6-4342-8dda-ba0daa580fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:07.755422 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ffee2-a6f6-4342-8dda-ba0daa580fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:07.775365 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3d5ffee2-a6f6-4342-8dda-ba0daa580fe7 None None] MFA Rules not processed for user `2c9c99e70fef461aaaf238a84227f993`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:40:07.776564 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3d5ffee2-a6f6-4342-8dda-ba0daa580fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:07.785033 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1370/2758] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:40:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:40:16.360812 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=17 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:40:17.769163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:40:21.956284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2d1c1-3717-4082-ab34-6b3e1d71a8b6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:21.956910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2d1c1-3717-4082-ab34-6b3e1d71a8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:21.956910 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2d1c1-3717-4082-ab34-6b3e1d71a8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:21.980868 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e1b2d1c1-3717-4082-ab34-6b3e1d71a8b6 None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:40:21.982317 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e1b2d1c1-3717-4082-ab34-6b3e1d71a8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:22.044203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1389/2759] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:40:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:40:22.077744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ffee2-a6f6-4342-8dda-ba0daa580fe7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:22.079478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3d5ffee2-a6f6-4342-8dda-ba0daa580fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:22.155324 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ffee2-a6f6-4342-8dda-ba0daa580fe7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:22.161188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926790-26f6-48b3-a0b6-819a6af5fc5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:22.162106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926790-26f6-48b3-a0b6-819a6af5fc5c service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:22.162363 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926790-26f6-48b3-a0b6-819a6af5fc5c service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:22.162639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926790-26f6-48b3-a0b6-819a6af5fc5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:22.173004 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02926790-26f6-48b3-a0b6-819a6af5fc5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:22.175126 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02926790-26f6-48b3-a0b6-819a6af5fc5c service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:22.184723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1371/2760] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:40:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 20:40:22.708899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147759b-19ba-4635-a2cb-c51552d3b972 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:22.709224 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147759b-19ba-4635-a2cb-c51552d3b972 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:22.709503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147759b-19ba-4635-a2cb-c51552d3b972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:22.727712 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b147759b-19ba-4635-a2cb-c51552d3b972 None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:40:22.728992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b147759b-19ba-4635-a2cb-c51552d3b972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:22.736320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1390/2761] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jul 6 20:40:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:40:22.754004 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926790-26f6-48b3-a0b6-819a6af5fc5c service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:22.766392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926790-26f6-48b3-a0b6-819a6af5fc5c service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:22.772828 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b28cf-7a36-4b89-9291-a0312bc638c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:22.773448 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b28cf-7a36-4b89-9291-a0312bc638c1 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:22.773951 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b28cf-7a36-4b89-9291-a0312bc638c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:22.774426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b28cf-7a36-4b89-9291-a0312bc638c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:22.784032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b28cf-7a36-4b89-9291-a0312bc638c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:22.785778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b28cf-7a36-4b89-9291-a0312bc638c1 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:22.795158 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1372/2762] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:40:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:40:23.014950 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e58d-6fd7-4ecd-a22d-e66b864794eb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:23.015450 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e58d-6fd7-4ecd-a22d-e66b864794eb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:23.015531 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e58d-6fd7-4ecd-a22d-e66b864794eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:23.033722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fa57e58d-6fd7-4ecd-a22d-e66b864794eb None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:40:23.034901 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fa57e58d-6fd7-4ecd-a22d-e66b864794eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:23.042625 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1391/2763] 10.222.0.30 () {58 vars in 1009 bytes} [Wed Jul 6 20:40:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:40:23.054878 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b28cf-7a36-4b89-9291-a0312bc638c1 service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:23.066278 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b28cf-7a36-4b89-9291-a0312bc638c1 service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:23.071845 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda21df-be39-43b3-aad8-d33da07fa65e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:23.072518 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda21df-be39-43b3-aad8-d33da07fa65e service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:23.072804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda21df-be39-43b3-aad8-d33da07fa65e service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:23.073123 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda21df-be39-43b3-aad8-d33da07fa65e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:23.081227 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda21df-be39-43b3-aad8-d33da07fa65e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:23.082836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda21df-be39-43b3-aad8-d33da07fa65e service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:23.091178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1373/2764] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:40:23.441593 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c32b6-504a-41bd-ade8-d8f4f076eece None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:23.442081 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c32b6-504a-41bd-ade8-d8f4f076eece None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:23.442485 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c32b6-504a-41bd-ade8-d8f4f076eece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:23.462399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-914c32b6-504a-41bd-ade8-d8f4f076eece None None] MFA Rules not processed for user `d869f947e5b14979b7f44aa19be9ae50`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:40:23.464436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-914c32b6-504a-41bd-ade8-d8f4f076eece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:23.472643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1392/2765] 10.222.0.30 () {58 vars in 967 bytes} [Wed Jul 6 20:40:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:40:23.484993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda21df-be39-43b3-aad8-d33da07fa65e service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:23.498594 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda21df-be39-43b3-aad8-d33da07fa65e service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:23.504091 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9850fcd-8cfd-4858-80f5-578962a97a26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11e395dab424f3492f092eb3d5032dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:23.504746 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9850fcd-8cfd-4858-80f5-578962a97a26 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:23.505062 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9850fcd-8cfd-4858-80f5-578962a97a26 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:23.505337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9850fcd-8cfd-4858-80f5-578962a97a26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:23.515614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9850fcd-8cfd-4858-80f5-578962a97a26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:23.517260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9850fcd-8cfd-4858-80f5-578962a97a26 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:23.525634 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1374/2766] 10.222.0.30 () {60 vars in 1384 bytes} [Wed Jul 6 20:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:40:25.616129 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c32b6-504a-41bd-ade8-d8f4f076eece None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:25.687489 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c32b6-504a-41bd-ade8-d8f4f076eece None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:25.692322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:25.693279 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:25.693585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:25.693857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] PATH_INFO: `/v3/users/2c9c99e70fef461aaaf238a84227f993` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:25.695063 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9c99e70fef461aaaf238a84227f993)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:25.697076 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:25.750339 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9c99e70fef461aaaf238a84227f993'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:25.762996 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9c99e70fef461aaaf238a84227f993'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:25.763736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9c99e70fef461aaaf238a84227f993'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:25.771911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9c99e70fef461aaaf238a84227f993'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:25.778927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9c99e70fef461aaaf238a84227f993'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:25.784896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1393/2767] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:40:25 2022] DELETE /identity/v3/users/2c9c99e70fef461aaaf238a84227f993 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:40:25.789815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e97803-7898-40a7-9be3-7ccd1ed70bcd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:25.790347 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e97803-7898-40a7-9be3-7ccd1ed70bcd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:25.790463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e97803-7898-40a7-9be3-7ccd1ed70bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:25.810114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-52e97803-7898-40a7-9be3-7ccd1ed70bcd None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:40:25.811502 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-52e97803-7898-40a7-9be3-7ccd1ed70bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:25.879631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1375/2768] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:40:25.889903 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:25.891435 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:25.899027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:40:25.956221 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435431a8-9733-4aec-9ca9-a78edcb6a7fc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:25.960433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14590eb3-2172-477f-8554-b5f89771007e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:25.961134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14590eb3-2172-477f-8554-b5f89771007e service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:25.961417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14590eb3-2172-477f-8554-b5f89771007e service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:25.961689 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14590eb3-2172-477f-8554-b5f89771007e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:25.970767 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14590eb3-2172-477f-8554-b5f89771007e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:25.972192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14590eb3-2172-477f-8554-b5f89771007e service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:25.981839 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1394/2769] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:40:26.172368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e97803-7898-40a7-9be3-7ccd1ed70bcd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:26.174010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-52e97803-7898-40a7-9be3-7ccd1ed70bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:26.193433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e97803-7898-40a7-9be3-7ccd1ed70bcd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:26.198532 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:26.199402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:26.200010 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:26.200496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] PATH_INFO: `/v3/projects/8f39828d2bcf4016be990bca2f111f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:26.201795 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f39828d2bcf4016be990bca2f111f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:26.203719 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:26.251081 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:40:26.253802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f39828d2bcf4016be990bca2f111f7a', 'request_id': 'req-3887b942-ebca-4bd6-9885-49450e92ace8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:26.263974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f39828d2bcf4016be990bca2f111f7a', 'request_id': 'req-3887b942-ebca-4bd6-9885-49450e92ace8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:26.269859 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f39828d2bcf4016be990bca2f111f7a', 'request_id': 'req-3887b942-ebca-4bd6-9885-49450e92ace8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:26.281308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] The token cache is being invalidate because project 8f39828d2bcf4016be990bca2f111f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:40:26.281599 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:26.282253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3887b942-ebca-4bd6-9885-49450e92ace8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:26.283812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1376/2770] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:40:26 2022] DELETE /identity/v3/projects/8f39828d2bcf4016be990bca2f111f7a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:40:30.620537 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14590eb3-2172-477f-8554-b5f89771007e service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:30.622219 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-14590eb3-2172-477f-8554-b5f89771007e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:30.633911 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14590eb3-2172-477f-8554-b5f89771007e service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:30.683970 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119f843-f193-4f4a-a948-568a6917c5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:30.684834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119f843-f193-4f4a-a948-568a6917c5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:30.685150 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119f843-f193-4f4a-a948-568a6917c5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:30.685436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119f843-f193-4f4a-a948-568a6917c5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:30.687297 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3119f843-f193-4f4a-a948-568a6917c5c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:30.759227 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119f843-f193-4f4a-a948-568a6917c5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:30.760713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119f843-f193-4f4a-a948-568a6917c5c2 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:30.770675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1395/2771] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:40:31.097025 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57e5ec-6f43-46cb-9025-c1a9be5e1e7d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:31.097539 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57e5ec-6f43-46cb-9025-c1a9be5e1e7d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:31.097812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57e5ec-6f43-46cb-9025-c1a9be5e1e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:31.116099 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5e57e5ec-6f43-46cb-9025-c1a9be5e1e7d None None] MFA Rules not processed for user `b377f2751fa2446597aa6871650ec2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:40:31.117334 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5e57e5ec-6f43-46cb-9025-c1a9be5e1e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:31.174275 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1377/2772] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:40:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:40:38.615953 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119f843-f193-4f4a-a948-568a6917c5c2 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:38.617747 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3119f843-f193-4f4a-a948-568a6917c5c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:38.631116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119f843-f193-4f4a-a948-568a6917c5c2 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:38.637875 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:38.639372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:38.639372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:38.639372 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] PATH_INFO: `/v3/users/e23fcb16b89d4fe6a6f03466f8d0d575` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:38.640672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e23fcb16b89d4fe6a6f03466f8d0d575)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:38.642649 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:38.692353 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e23fcb16b89d4fe6a6f03466f8d0d575'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:38.696959 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:40:38.705993 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e23fcb16b89d4fe6a6f03466f8d0d575'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:38.706708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e23fcb16b89d4fe6a6f03466f8d0d575'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:38.714399 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e23fcb16b89d4fe6a6f03466f8d0d575'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:38.721890 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e23fcb16b89d4fe6a6f03466f8d0d575'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:38.728437 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1396/2773] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:40:38 2022] DELETE /identity/v3/users/e23fcb16b89d4fe6a6f03466f8d0d575 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:40:38.923384 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57e5ec-6f43-46cb-9025-c1a9be5e1e7d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:38.935487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57e5ec-6f43-46cb-9025-c1a9be5e1e7d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:38.994803 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:38.995615 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:38.995898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:38.996172 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] PATH_INFO: `/v3/projects/90d3bf726a8248058cbb95795b454dd1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:38.997540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d3bf726a8248058cbb95795b454dd1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:38.999481 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:39.050530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d3bf726a8248058cbb95795b454dd1', 'request_id': 'req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.060203 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d3bf726a8248058cbb95795b454dd1', 'request_id': 'req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.067072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d3bf726a8248058cbb95795b454dd1', 'request_id': 'req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.079157 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] The token cache is being invalidate because project 90d3bf726a8248058cbb95795b454dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:40:39.079514 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.080188 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.081981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1378/2774] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:40:38 2022] DELETE /identity/v3/projects/90d3bf726a8248058cbb95795b454dd1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:40:39.087170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:39.088668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:39.103937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06aecd-22e7-45c8-94ef-a190c83a998c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:39.182067 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:39.182995 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:39.183282 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:39.183556 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] PATH_INFO: `/v3/users/f487619bbb57419a8de600b156c0fb7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:39.184985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f487619bbb57419a8de600b156c0fb7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:39.186949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:39.275806 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f487619bbb57419a8de600b156c0fb7a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.295928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f487619bbb57419a8de600b156c0fb7a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.296675 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f487619bbb57419a8de600b156c0fb7a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.305456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f487619bbb57419a8de600b156c0fb7a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.313056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f487619bbb57419a8de600b156c0fb7a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.320988 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1397/2775] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:40:39 2022] DELETE /identity/v3/users/f487619bbb57419a8de600b156c0fb7a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:40:39.596580 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:40:39.598122 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:40:39.613590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64e6c0-d44b-44e8-942d-9ed4c683e9e3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:40:39.619214 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:40:39.678100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:40:39.678990 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:40:39.679237 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:40:39.679519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] PATH_INFO: `/v3/projects/a71a1d7f6ddf4fabb0ec2e6957eee937` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:40:39.680694 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71a1d7f6ddf4fabb0ec2e6957eee937)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:40:39.682643 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:40:39.729660 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71a1d7f6ddf4fabb0ec2e6957eee937', 'request_id': 'req-53e6c1a2-0655-431e-951b-bdd7855f036b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.738900 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71a1d7f6ddf4fabb0ec2e6957eee937', 'request_id': 'req-53e6c1a2-0655-431e-951b-bdd7855f036b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.744758 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71a1d7f6ddf4fabb0ec2e6957eee937', 'request_id': 'req-53e6c1a2-0655-431e-951b-bdd7855f036b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.755479 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] The token cache is being invalidate because project a71a1d7f6ddf4fabb0ec2e6957eee937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:40:39.755764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.756385 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:40:39.757941 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1379/2776] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:40:39 2022] DELETE /identity/v3/projects/a71a1d7f6ddf4fabb0ec2e6957eee937 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:40:49.316381 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=13,keystone:SELECT=63,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:40:49.752779 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:20.589955 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:20.592746 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:20.658786 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df526a1-4222-4c43-b8f9-a9a537e0f0f3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:20.707140 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8494b5-9697-492b-99c9-39fa6ef46ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:20.707779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8494b5-9697-492b-99c9-39fa6ef46ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:20.708053 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8494b5-9697-492b-99c9-39fa6ef46ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:20.708323 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8494b5-9697-492b-99c9-39fa6ef46ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:20.710428 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3b8494b5-9697-492b-99c9-39fa6ef46ce9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:20.791773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8494b5-9697-492b-99c9-39fa6ef46ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:20.793149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8494b5-9697-492b-99c9-39fa6ef46ce9 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:20.804501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1398/2777] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:27.569921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.572353 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:27.591666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6c1a2-0655-431e-951b-bdd7855f036b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.596190 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed70fa-4cc6-40a9-ab5c-8e43e8fb467c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.596847 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed70fa-4cc6-40a9-ab5c-8e43e8fb467c service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.597161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed70fa-4cc6-40a9-ab5c-8e43e8fb467c service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.597427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed70fa-4cc6-40a9-ab5c-8e43e8fb467c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.599414 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-feed70fa-4cc6-40a9-ab5c-8e43e8fb467c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:27.618151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed70fa-4cc6-40a9-ab5c-8e43e8fb467c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.620412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed70fa-4cc6-40a9-ab5c-8e43e8fb467c service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.633277 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1380/2778] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:30.799411 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=74 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:34.642693 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db0c43-dc67-470c-b5a3-2f16df34858a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:34.643319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db0c43-dc67-470c-b5a3-2f16df34858a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:34.643319 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db0c43-dc67-470c-b5a3-2f16df34858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:34.661223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d4db0c43-dc67-470c-b5a3-2f16df34858a None None] MFA Rules not processed for user `b377f2751fa2446597aa6871650ec2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:34.662455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d4db0c43-dc67-470c-b5a3-2f16df34858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:34.723160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1399/2779] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:41:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:35.029949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed70fa-4cc6-40a9-ab5c-8e43e8fb467c service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:35.031586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-feed70fa-4cc6-40a9-ab5c-8e43e8fb467c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:35.093427 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed70fa-4cc6-40a9-ab5c-8e43e8fb467c service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:35.097453 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349def0-31bc-4014-964a-57cfff205097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:35.098108 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349def0-31bc-4014-964a-57cfff205097 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:35.098390 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349def0-31bc-4014-964a-57cfff205097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:35.098669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349def0-31bc-4014-964a-57cfff205097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:35.100616 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9349def0-31bc-4014-964a-57cfff205097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:35.112391 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349def0-31bc-4014-964a-57cfff205097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:35.113869 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349def0-31bc-4014-964a-57cfff205097 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:35.123432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1381/2780] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:35.465149 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db0c43-dc67-470c-b5a3-2f16df34858a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:35.466569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d4db0c43-dc67-470c-b5a3-2f16df34858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:35.546509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db0c43-dc67-470c-b5a3-2f16df34858a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:35.551370 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e6be5-6e43-4f6f-b0a9-95bcfe96b073 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df36a267464042908bbd8eebc7c40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:35.552026 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e6be5-6e43-4f6f-b0a9-95bcfe96b073 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:35.552308 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e6be5-6e43-4f6f-b0a9-95bcfe96b073 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:35.552586 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e6be5-6e43-4f6f-b0a9-95bcfe96b073 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:35.554527 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4f8e6be5-6e43-4f6f-b0a9-95bcfe96b073 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:35.566201 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e6be5-6e43-4f6f-b0a9-95bcfe96b073 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:35.567761 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e6be5-6e43-4f6f-b0a9-95bcfe96b073 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:35.577716 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1400/2781] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:37.281603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349def0-31bc-4014-964a-57cfff205097 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:37.283289 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9349def0-31bc-4014-964a-57cfff205097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:37.294194 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349def0-31bc-4014-964a-57cfff205097 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:37.299734 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596908aa-09d9-49bf-9516-5bec6ce7575a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:37.301330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596908aa-09d9-49bf-9516-5bec6ce7575a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:37.301330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596908aa-09d9-49bf-9516-5bec6ce7575a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:37.301330 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596908aa-09d9-49bf-9516-5bec6ce7575a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:37.303402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-596908aa-09d9-49bf-9516-5bec6ce7575a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:37.314389 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596908aa-09d9-49bf-9516-5bec6ce7575a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:37.315903 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596908aa-09d9-49bf-9516-5bec6ce7575a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:37.325388 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1382/2782] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:45.573808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=57 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:47.322092 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=38 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:47.363795 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e6be5-6e43-4f6f-b0a9-95bcfe96b073 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:47.365305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4f8e6be5-6e43-4f6f-b0a9-95bcfe96b073 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:47.380623 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e6be5-6e43-4f6f-b0a9-95bcfe96b073 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:47.386514 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddf560-2c2e-4037-837a-efb5849d6e95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:47.387327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf560-2c2e-4037-837a-efb5849d6e95 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.387668 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf560-2c2e-4037-837a-efb5849d6e95 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.388119 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf560-2c2e-4037-837a-efb5849d6e95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.390048 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6ddf560-2c2e-4037-837a-efb5849d6e95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:47.403187 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddf560-2c2e-4037-837a-efb5849d6e95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:47.404906 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddf560-2c2e-4037-837a-efb5849d6e95 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:47.416069 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1401/2783] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:57.411328 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:28.980297 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596908aa-09d9-49bf-9516-5bec6ce7575a service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:28.981858 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-596908aa-09d9-49bf-9516-5bec6ce7575a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:28.998550 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596908aa-09d9-49bf-9516-5bec6ce7575a service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:29.005416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a4439-1fd2-4012-bde8-5df6ae276a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ad461f6dc54014a956e5c8a094352c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:29.006680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a4439-1fd2-4012-bde8-5df6ae276a55 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:29.006680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a4439-1fd2-4012-bde8-5df6ae276a55 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:29.006680 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a4439-1fd2-4012-bde8-5df6ae276a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:29.008576 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e14a4439-1fd2-4012-bde8-5df6ae276a55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:29.023630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a4439-1fd2-4012-bde8-5df6ae276a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:29.025446 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a4439-1fd2-4012-bde8-5df6ae276a55 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:29.037260 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1383/2784] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:37.786322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddf560-2c2e-4037-837a-efb5849d6e95 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:37.787834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6ddf560-2c2e-4037-837a-efb5849d6e95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:37.856220 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddf560-2c2e-4037-837a-efb5849d6e95 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:37.860978 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f55f0-b6fd-4ccf-88de-79f415c58822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:37.861892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f55f0-b6fd-4ccf-88de-79f415c58822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:37.862175 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f55f0-b6fd-4ccf-88de-79f415c58822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:37.862451 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f55f0-b6fd-4ccf-88de-79f415c58822 admin admin] PATH_INFO: `/v3/users/b377f2751fa2446597aa6871650ec2f9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:37.863697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f55f0-b6fd-4ccf-88de-79f415c58822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b377f2751fa2446597aa6871650ec2f9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:37.865777 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f55f0-b6fd-4ccf-88de-79f415c58822 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:37.914667 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-344f55f0-b6fd-4ccf-88de-79f415c58822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b377f2751fa2446597aa6871650ec2f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:37.927004 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-344f55f0-b6fd-4ccf-88de-79f415c58822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b377f2751fa2446597aa6871650ec2f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:37.927692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-344f55f0-b6fd-4ccf-88de-79f415c58822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b377f2751fa2446597aa6871650ec2f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:37.935919 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-344f55f0-b6fd-4ccf-88de-79f415c58822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b377f2751fa2446597aa6871650ec2f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:37.943018 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-344f55f0-b6fd-4ccf-88de-79f415c58822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b377f2751fa2446597aa6871650ec2f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:37.948893 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1402/2785] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:37 2022] DELETE /identity/v3/users/b377f2751fa2446597aa6871650ec2f9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:38.131189 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a4439-1fd2-4012-bde8-5df6ae276a55 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:38.143864 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a4439-1fd2-4012-bde8-5df6ae276a55 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:38.202932 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:38.203799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:38.204072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:38.204371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] PATH_INFO: `/v3/projects/748942b14b014c869ef36c668d6e0b75` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:38.205604 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=748942b14b014c869ef36c668d6e0b75)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:38.207476 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:38.259711 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748942b14b014c869ef36c668d6e0b75', 'request_id': 'req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:38.269332 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748942b14b014c869ef36c668d6e0b75', 'request_id': 'req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:38.275898 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748942b14b014c869ef36c668d6e0b75', 'request_id': 'req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:38.286949 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] The token cache is being invalidate because project 748942b14b014c869ef36c668d6e0b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:38.287241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:38.287868 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cb0acb78-84a2-4130-8c1b-2cb6d2a86459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:38.289472 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1384/2786] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:38 2022] DELETE /identity/v3/projects/748942b14b014c869ef36c668d6e0b75 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:38.294475 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5b13-fca8-4162-9c7b-a53a4018bfc9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:38.294749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5b13-fca8-4162-9c7b-a53a4018bfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:38.295024 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5b13-fca8-4162-9c7b-a53a4018bfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:38.314289 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c06e5b13-fca8-4162-9c7b-a53a4018bfc9 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:38.315420 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c06e5b13-fca8-4162-9c7b-a53a4018bfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:38.379299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1403/2787] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:38.387309 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8add01-d3aa-4425-b861-9afef8af4403 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:38.387623 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8add01-d3aa-4425-b861-9afef8af4403 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:38.387897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8add01-d3aa-4425-b861-9afef8af4403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:38.406607 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0f8add01-d3aa-4425-b861-9afef8af4403 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:38.407822 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0f8add01-d3aa-4425-b861-9afef8af4403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:38.415889 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1385/2788] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:38.420090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e5b13-fca8-4162-9c7b-a53a4018bfc9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:38.430520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e5b13-fca8-4162-9c7b-a53a4018bfc9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:38.435845 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e545-1810-4197-80d5-9a5b8f5b7948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:38.436501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e545-1810-4197-80d5-9a5b8f5b7948 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:38.436779 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e545-1810-4197-80d5-9a5b8f5b7948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:38.437078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e545-1810-4197-80d5-9a5b8f5b7948 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:38.437830 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811e545-1810-4197-80d5-9a5b8f5b7948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:38.438134 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811e545-1810-4197-80d5-9a5b8f5b7948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:38.439716 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811e545-1810-4197-80d5-9a5b8f5b7948 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:38.452379 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1404/2789] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:38.456972 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8add01-d3aa-4425-b861-9afef8af4403 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:38.466983 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8add01-d3aa-4425-b861-9afef8af4403 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:38.472426 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0f0f5-29f5-4322-afbb-3a0898f30a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:38.473245 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0f0f5-29f5-4322-afbb-3a0898f30a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:38.473463 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0f0f5-29f5-4322-afbb-3a0898f30a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:38.473741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0f0f5-29f5-4322-afbb-3a0898f30a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:38.474667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0f0f5-29f5-4322-afbb-3a0898f30a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:38.476567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0f0f5-29f5-4322-afbb-3a0898f30a32 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:38.505399 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1386/2790] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:38 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:38.509644 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e545-1810-4197-80d5-9a5b8f5b7948 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:38.519581 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e545-1810-4197-80d5-9a5b8f5b7948 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:38.523167 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:38.575941 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd19e9-eab4-4e80-9536-9a6e8b601b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:38.576537 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd19e9-eab4-4e80-9536-9a6e8b601b6c admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:38.576824 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd19e9-eab4-4e80-9536-9a6e8b601b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:38.577089 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd19e9-eab4-4e80-9536-9a6e8b601b6c admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:38.577800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd19e9-eab4-4e80-9536-9a6e8b601b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:38.579705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd19e9-eab4-4e80-9536-9a6e8b601b6c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:38.600800 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1405/2791] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:38 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:38.606799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0f0f5-29f5-4322-afbb-3a0898f30a32 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:38.621296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0f0f5-29f5-4322-afbb-3a0898f30a32 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:38.627376 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64682d1f-f835-4a36-8fa8-1fe2144a4e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:38.628045 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682d1f-f835-4a36-8fa8-1fe2144a4e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:38.628326 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682d1f-f835-4a36-8fa8-1fe2144a4e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:38.628598 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682d1f-f835-4a36-8fa8-1fe2144a4e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:38.629378 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64682d1f-f835-4a36-8fa8-1fe2144a4e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:38.630963 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64682d1f-f835-4a36-8fa8-1fe2144a4e25 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:38.641688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1387/2792] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:38.645631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd19e9-eab4-4e80-9536-9a6e8b601b6c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:38.656381 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd19e9-eab4-4e80-9536-9a6e8b601b6c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:38.662091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718153d-d047-4dd4-ae87-f3210bcc4ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:38.662830 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718153d-d047-4dd4-ae87-f3210bcc4ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:38.663132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718153d-d047-4dd4-ae87-f3210bcc4ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:38.663433 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718153d-d047-4dd4-ae87-f3210bcc4ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:38.664179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718153d-d047-4dd4-ae87-f3210bcc4ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:38.665977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718153d-d047-4dd4-ae87-f3210bcc4ae4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:38.676084 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1406/2793] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:38.680178 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64682d1f-f835-4a36-8fa8-1fe2144a4e25 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:38.691124 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64682d1f-f835-4a36-8fa8-1fe2144a4e25 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:38.696155 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c8593-bc69-4a32-84a4-a9b1b8308d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:38.697082 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c8593-bc69-4a32-84a4-a9b1b8308d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:38.697365 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c8593-bc69-4a32-84a4-a9b1b8308d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:38.697640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c8593-bc69-4a32-84a4-a9b1b8308d43 admin admin] PATH_INFO: `/v3/projects/fed323e44edf426db2c5bf5967bc5eee/users/c483e76d198f4e6aafab3e243dc74fe8/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:38.712199 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c8593-bc69-4a32-84a4-a9b1b8308d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed323e44edf426db2c5bf5967bc5eee, user_id=c483e76d198f4e6aafab3e243dc74fe8, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:38.714893 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c8593-bc69-4a32-84a4-a9b1b8308d43 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:38.730403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1388/2794] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:38 2022] PUT /identity/v3/projects/fed323e44edf426db2c5bf5967bc5eee/users/c483e76d198f4e6aafab3e243dc74fe8/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:38.740597 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f41a4-7dbe-4584-a8b2-7713056ada9a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:38.740886 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f41a4-7dbe-4584-a8b2-7713056ada9a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:38.741204 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f41a4-7dbe-4584-a8b2-7713056ada9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:38.769401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fc1f41a4-7dbe-4584-a8b2-7713056ada9a None None] MFA Rules not processed for user `c483e76d198f4e6aafab3e243dc74fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:38.770610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fc1f41a4-7dbe-4584-a8b2-7713056ada9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:38.838043 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1407/2795] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:38.842778 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c8593-bc69-4a32-84a4-a9b1b8308d43 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:38.858359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:38.909111 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c8593-bc69-4a32-84a4-a9b1b8308d43 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:38.913978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf8464-59d8-4c0e-9c98-8f2de2ab66ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:38.914639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8464-59d8-4c0e-9c98-8f2de2ab66ce admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:38.914920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8464-59d8-4c0e-9c98-8f2de2ab66ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:38.915200 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8464-59d8-4c0e-9c98-8f2de2ab66ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:38.915895 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf8464-59d8-4c0e-9c98-8f2de2ab66ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:38.918022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf8464-59d8-4c0e-9c98-8f2de2ab66ce admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:38.946218 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1389/2796] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:38 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:38.950292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f41a4-7dbe-4584-a8b2-7713056ada9a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:38.961082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f41a4-7dbe-4584-a8b2-7713056ada9a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:39.018635 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe515c-b546-4a2e-ae93-2e9c140ccfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:39.019305 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe515c-b546-4a2e-ae93-2e9c140ccfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.019590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe515c-b546-4a2e-ae93-2e9c140ccfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.019865 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe515c-b546-4a2e-ae93-2e9c140ccfc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.020547 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe515c-b546-4a2e-ae93-2e9c140ccfc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:39.022615 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe515c-b546-4a2e-ae93-2e9c140ccfc9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:39.045446 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1408/2797] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:38 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:39.050964 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf8464-59d8-4c0e-9c98-8f2de2ab66ce admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:39.061903 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf8464-59d8-4c0e-9c98-8f2de2ab66ce admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:39.067050 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103ccea-331e-4578-bcc0-9b79b67b87f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:39.067715 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103ccea-331e-4578-bcc0-9b79b67b87f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.068022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103ccea-331e-4578-bcc0-9b79b67b87f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.068294 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103ccea-331e-4578-bcc0-9b79b67b87f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.069069 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103ccea-331e-4578-bcc0-9b79b67b87f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:39.070681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103ccea-331e-4578-bcc0-9b79b67b87f6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:39.082418 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1390/2798] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:42:39.086590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe515c-b546-4a2e-ae93-2e9c140ccfc9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:39.092998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:39.097241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe515c-b546-4a2e-ae93-2e9c140ccfc9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:39.102872 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42238f-3297-49db-9999-51cbdb169fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:39.103754 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42238f-3297-49db-9999-51cbdb169fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.104025 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42238f-3297-49db-9999-51cbdb169fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.104293 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42238f-3297-49db-9999-51cbdb169fbb admin admin] PATH_INFO: `/v3/projects/7fe28203583348468889fdf8b6ce9247/users/ae9cd2c278fc40548e5f3af59cb6cda7/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.118965 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42238f-3297-49db-9999-51cbdb169fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe28203583348468889fdf8b6ce9247, user_id=ae9cd2c278fc40548e5f3af59cb6cda7, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:39.121631 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42238f-3297-49db-9999-51cbdb169fbb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:39.135848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1409/2799] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:39 2022] PUT /identity/v3/projects/7fe28203583348468889fdf8b6ce9247/users/ae9cd2c278fc40548e5f3af59cb6cda7/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:39.140175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103ccea-331e-4578-bcc0-9b79b67b87f6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:39.150628 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103ccea-331e-4578-bcc0-9b79b67b87f6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:39.210529 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629ddf8-016e-4d33-8554-e0972f290cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:39.211196 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ddf8-016e-4d33-8554-e0972f290cab admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.211477 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ddf8-016e-4d33-8554-e0972f290cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.211751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ddf8-016e-4d33-8554-e0972f290cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.212478 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629ddf8-016e-4d33-8554-e0972f290cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:39.214129 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629ddf8-016e-4d33-8554-e0972f290cab admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:39.224263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1391/2800] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:42:39.228558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42238f-3297-49db-9999-51cbdb169fbb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:39.240239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42238f-3297-49db-9999-51cbdb169fbb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:39.245859 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004cc49-1623-4dfa-bdaf-daecabdb47db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:39.246748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004cc49-1623-4dfa-bdaf-daecabdb47db admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.247028 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004cc49-1623-4dfa-bdaf-daecabdb47db admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.247296 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004cc49-1623-4dfa-bdaf-daecabdb47db admin admin] PATH_INFO: `/v3/projects/7fe28203583348468889fdf8b6ce9247/users/ae9cd2c278fc40548e5f3af59cb6cda7/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.249393 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004cc49-1623-4dfa-bdaf-daecabdb47db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe28203583348468889fdf8b6ce9247, user_id=ae9cd2c278fc40548e5f3af59cb6cda7, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:39.252035 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004cc49-1623-4dfa-bdaf-daecabdb47db admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:39.262676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1410/2801] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:39 2022] PUT /identity/v3/projects/7fe28203583348468889fdf8b6ce9247/users/ae9cd2c278fc40548e5f3af59cb6cda7/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:39.275341 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f3301-cee5-459d-bf7e-bb8092df8212 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.275757 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f3301-cee5-459d-bf7e-bb8092df8212 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.276186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f3301-cee5-459d-bf7e-bb8092df8212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.308985 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4c5f3301-cee5-459d-bf7e-bb8092df8212 None None] MFA Rules not processed for user `ae9cd2c278fc40548e5f3af59cb6cda7`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:39.310211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4c5f3301-cee5-459d-bf7e-bb8092df8212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:39.379587 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1392/2802] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:39.391321 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004cc49-1623-4dfa-bdaf-daecabdb47db admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:39.393203 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2004cc49-1623-4dfa-bdaf-daecabdb47db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:39.450758 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004cc49-1623-4dfa-bdaf-daecabdb47db admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:39.455466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bfcab-579a-4bc4-ba27-ed0c16cfec0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:39.456103 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bfcab-579a-4bc4-ba27-ed0c16cfec0f service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.456386 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bfcab-579a-4bc4-ba27-ed0c16cfec0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.456666 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bfcab-579a-4bc4-ba27-ed0c16cfec0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.466461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bfcab-579a-4bc4-ba27-ed0c16cfec0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:39.467949 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bfcab-579a-4bc4-ba27-ed0c16cfec0f service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:39.478272 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1411/2803] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:39.898143 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f3301-cee5-459d-bf7e-bb8092df8212 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:39.908022 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:39.962782 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f3301-cee5-459d-bf7e-bb8092df8212 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:39.967744 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:39.968614 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.968892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.969551 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] PATH_INFO: `/v3/users/c483e76d198f4e6aafab3e243dc74fe8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.970762 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c483e76d198f4e6aafab3e243dc74fe8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:39.972681 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:40.019590 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c483e76d198f4e6aafab3e243dc74fe8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.031066 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c483e76d198f4e6aafab3e243dc74fe8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.031722 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c483e76d198f4e6aafab3e243dc74fe8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.032326 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c483e76d198f4e6aafab3e243dc74fe8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.040772 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c483e76d198f4e6aafab3e243dc74fe8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.053571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1393/2804] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:39 2022] DELETE /identity/v3/users/c483e76d198f4e6aafab3e243dc74fe8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:40.058377 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9165126-c5b8-463a-8a6d-eca4c3a708c7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.058862 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9165126-c5b8-463a-8a6d-eca4c3a708c7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.058976 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9165126-c5b8-463a-8a6d-eca4c3a708c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.077361 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e9165126-c5b8-463a-8a6d-eca4c3a708c7 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:40.078569 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e9165126-c5b8-463a-8a6d-eca4c3a708c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.146059 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1412/2805] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:40.155836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:40.157392 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.218799 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79babed-9c6d-4b73-82da-3177d8c0884a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:40.223371 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f49b9b-0658-40cb-b3da-348c3e00c49f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:40.224023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49b9b-0658-40cb-b3da-348c3e00c49f service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.224308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49b9b-0658-40cb-b3da-348c3e00c49f service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.224584 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49b9b-0658-40cb-b3da-348c3e00c49f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.234623 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f49b9b-0658-40cb-b3da-348c3e00c49f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:40.236106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f49b9b-0658-40cb-b3da-348c3e00c49f service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:40.245803 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1394/2806] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:40.520691 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9165126-c5b8-463a-8a6d-eca4c3a708c7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:40.522202 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e9165126-c5b8-463a-8a6d-eca4c3a708c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.535618 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9165126-c5b8-463a-8a6d-eca4c3a708c7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:40.540542 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:40.541460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.541741 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.542010 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] PATH_INFO: `/v3/projects/fed323e44edf426db2c5bf5967bc5eee` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.543354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed323e44edf426db2c5bf5967bc5eee)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:40.545505 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:40.598004 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed323e44edf426db2c5bf5967bc5eee', 'request_id': 'req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.606962 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed323e44edf426db2c5bf5967bc5eee', 'request_id': 'req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.612774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed323e44edf426db2c5bf5967bc5eee', 'request_id': 'req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.613881 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:40.626961 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] The token cache is being invalidate because project fed323e44edf426db2c5bf5967bc5eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:40.627242 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.627869 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.629449 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1413/2807] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:40 2022] DELETE /identity/v3/projects/fed323e44edf426db2c5bf5967bc5eee => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:40.633865 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f49b9b-0658-40cb-b3da-348c3e00c49f service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:40.643781 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f49b9b-0658-40cb-b3da-348c3e00c49f service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:40.673432 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:40.703253 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670d957-c972-4a8d-82cd-d1e0d00d77df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:40.704125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d957-c972-4a8d-82cd-d1e0d00d77df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.704545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d957-c972-4a8d-82cd-d1e0d00d77df admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.704825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d957-c972-4a8d-82cd-d1e0d00d77df admin admin] PATH_INFO: `/v3/users/ae9cd2c278fc40548e5f3af59cb6cda7` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.706134 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670d957-c972-4a8d-82cd-d1e0d00d77df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9cd2c278fc40548e5f3af59cb6cda7)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:40.708057 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670d957-c972-4a8d-82cd-d1e0d00d77df admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:40.766077 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f670d957-c972-4a8d-82cd-d1e0d00d77df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9cd2c278fc40548e5f3af59cb6cda7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.778559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f670d957-c972-4a8d-82cd-d1e0d00d77df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9cd2c278fc40548e5f3af59cb6cda7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.779222 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f670d957-c972-4a8d-82cd-d1e0d00d77df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9cd2c278fc40548e5f3af59cb6cda7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.779841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f670d957-c972-4a8d-82cd-d1e0d00d77df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9cd2c278fc40548e5f3af59cb6cda7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.789797 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f670d957-c972-4a8d-82cd-d1e0d00d77df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9cd2c278fc40548e5f3af59cb6cda7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.803354 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1395/2808] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:40 2022] DELETE /identity/v3/users/ae9cd2c278fc40548e5f3af59cb6cda7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:41.086322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.087954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:41.104857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf44c6b-daf5-4442-b29a-fb10ffd766ae admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.169303 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.170170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.170448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.170719 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] PATH_INFO: `/v3/projects/7fe28203583348468889fdf8b6ce9247` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.171963 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe28203583348468889fdf8b6ce9247)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.173913 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.221749 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe28203583348468889fdf8b6ce9247', 'request_id': 'req-58806366-3340-4abc-8893-24e3c80f3a26'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:41.230018 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe28203583348468889fdf8b6ce9247', 'request_id': 'req-58806366-3340-4abc-8893-24e3c80f3a26'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:41.235592 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe28203583348468889fdf8b6ce9247', 'request_id': 'req-58806366-3340-4abc-8893-24e3c80f3a26'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:41.246832 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] The token cache is being invalidate because project 7fe28203583348468889fdf8b6ce9247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:41.247131 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:41.247813 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58806366-3340-4abc-8893-24e3c80f3a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:41.249470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1414/2809] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:41 2022] DELETE /identity/v3/projects/7fe28203583348468889fdf8b6ce9247 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:41.254533 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11128-a7d6-4e6c-b702-e3e545001874 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.255005 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11128-a7d6-4e6c-b702-e3e545001874 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.255101 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11128-a7d6-4e6c-b702-e3e545001874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.273846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2aa11128-a7d6-4e6c-b702-e3e545001874 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:41.275054 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2aa11128-a7d6-4e6c-b702-e3e545001874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:41.336685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1396/2810] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:41.345178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501dc8e-af8a-46e8-91da-e89ba80b2ce3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.345462 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501dc8e-af8a-46e8-91da-e89ba80b2ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.345734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501dc8e-af8a-46e8-91da-e89ba80b2ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.368223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e501dc8e-af8a-46e8-91da-e89ba80b2ce3 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:41.369474 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e501dc8e-af8a-46e8-91da-e89ba80b2ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:41.379218 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1415/2811] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:41.383802 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa11128-a7d6-4e6c-b702-e3e545001874 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.396219 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa11128-a7d6-4e6c-b702-e3e545001874 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.402509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df617c42-514d-4758-ac9a-1b0905f33e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.403182 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df617c42-514d-4758-ac9a-1b0905f33e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.403466 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df617c42-514d-4758-ac9a-1b0905f33e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.403741 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df617c42-514d-4758-ac9a-1b0905f33e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.404480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df617c42-514d-4758-ac9a-1b0905f33e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:41.404791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df617c42-514d-4758-ac9a-1b0905f33e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.406480 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df617c42-514d-4758-ac9a-1b0905f33e79 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.418526 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1397/2812] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:41.422909 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501dc8e-af8a-46e8-91da-e89ba80b2ce3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.432534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501dc8e-af8a-46e8-91da-e89ba80b2ce3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.438290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514b15c-1095-4457-95f0-ba321151eee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.438892 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b15c-1095-4457-95f0-ba321151eee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.439170 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b15c-1095-4457-95f0-ba321151eee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.439436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b15c-1095-4457-95f0-ba321151eee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.440486 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514b15c-1095-4457-95f0-ba321151eee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.442423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514b15c-1095-4457-95f0-ba321151eee3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.470440 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1416/2813] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:41.474841 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df617c42-514d-4758-ac9a-1b0905f33e79 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.484988 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df617c42-514d-4758-ac9a-1b0905f33e79 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.518800 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:41.545019 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf4f14-32be-4928-a291-bbc6239285a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.545708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf4f14-32be-4928-a291-bbc6239285a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.545986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf4f14-32be-4928-a291-bbc6239285a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.546250 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf4f14-32be-4928-a291-bbc6239285a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.546952 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf4f14-32be-4928-a291-bbc6239285a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.548881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf4f14-32be-4928-a291-bbc6239285a8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.568263 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1398/2814] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:42:41.572522 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514b15c-1095-4457-95f0-ba321151eee3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.583774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514b15c-1095-4457-95f0-ba321151eee3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.589232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9d28f-b62b-4e6a-8dd8-48525840745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.589898 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9d28f-b62b-4e6a-8dd8-48525840745d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.590181 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9d28f-b62b-4e6a-8dd8-48525840745d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.590456 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9d28f-b62b-4e6a-8dd8-48525840745d admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.591192 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9d28f-b62b-4e6a-8dd8-48525840745d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.592799 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9d28f-b62b-4e6a-8dd8-48525840745d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.604292 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1417/2815] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:41.608355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf4f14-32be-4928-a291-bbc6239285a8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.619314 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf4f14-32be-4928-a291-bbc6239285a8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.624863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c10db-2850-4c42-878d-6cb850896cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.625561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c10db-2850-4c42-878d-6cb850896cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.625837 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c10db-2850-4c42-878d-6cb850896cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.626104 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c10db-2850-4c42-878d-6cb850896cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.626830 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c10db-2850-4c42-878d-6cb850896cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.628492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c10db-2850-4c42-878d-6cb850896cc6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.638940 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1399/2816] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:42:41.643091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9d28f-b62b-4e6a-8dd8-48525840745d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.653400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9d28f-b62b-4e6a-8dd8-48525840745d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.659096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ad010-dd3a-4be7-9cc0-1c5584f831ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.660015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ad010-dd3a-4be7-9cc0-1c5584f831ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.660290 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ad010-dd3a-4be7-9cc0-1c5584f831ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.660558 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ad010-dd3a-4be7-9cc0-1c5584f831ac admin admin] PATH_INFO: `/v3/projects/78671524df674e3fad31f59777520cfb/users/6e1f0907d87c4776aff3cc9e3c568619/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.675060 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ad010-dd3a-4be7-9cc0-1c5584f831ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=78671524df674e3fad31f59777520cfb, user_id=6e1f0907d87c4776aff3cc9e3c568619, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.677833 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ad010-dd3a-4be7-9cc0-1c5584f831ac admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.692920 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1418/2817] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:41 2022] PUT /identity/v3/projects/78671524df674e3fad31f59777520cfb/users/6e1f0907d87c4776aff3cc9e3c568619/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:41.703142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1830f9-6a47-4135-a56b-f27d77878e26 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.703431 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1830f9-6a47-4135-a56b-f27d77878e26 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.703708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1830f9-6a47-4135-a56b-f27d77878e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.730924 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-df1830f9-6a47-4135-a56b-f27d77878e26 None None] MFA Rules not processed for user `6e1f0907d87c4776aff3cc9e3c568619`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:41.732059 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-df1830f9-6a47-4135-a56b-f27d77878e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:41.800635 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1400/2818] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:41.805238 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ad010-dd3a-4be7-9cc0-1c5584f831ac admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.827139 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:41.870161 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ad010-dd3a-4be7-9cc0-1c5584f831ac admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.874948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a380f8-bac4-4951-b7dc-8531990f9e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.875612 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a380f8-bac4-4951-b7dc-8531990f9e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.875891 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a380f8-bac4-4951-b7dc-8531990f9e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.876160 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a380f8-bac4-4951-b7dc-8531990f9e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.876846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a380f8-bac4-4951-b7dc-8531990f9e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.878792 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a380f8-bac4-4951-b7dc-8531990f9e3a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.905716 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1419/2819] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:41.910559 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1830f9-6a47-4135-a56b-f27d77878e26 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.922974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1830f9-6a47-4135-a56b-f27d77878e26 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.981984 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8265a79-3e30-4e29-bec2-ca25283f98d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.982575 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8265a79-3e30-4e29-bec2-ca25283f98d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.982854 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8265a79-3e30-4e29-bec2-ca25283f98d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.983102 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8265a79-3e30-4e29-bec2-ca25283f98d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.983815 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8265a79-3e30-4e29-bec2-ca25283f98d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.985842 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8265a79-3e30-4e29-bec2-ca25283f98d7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.007881 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1401/2820] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:42.012228 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a380f8-bac4-4951-b7dc-8531990f9e3a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.024927 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a380f8-bac4-4951-b7dc-8531990f9e3a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.030492 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac09851-37a5-47a8-8d5d-99cf43161276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.031155 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac09851-37a5-47a8-8d5d-99cf43161276 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.031430 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac09851-37a5-47a8-8d5d-99cf43161276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.031695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac09851-37a5-47a8-8d5d-99cf43161276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.032429 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac09851-37a5-47a8-8d5d-99cf43161276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.034948 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac09851-37a5-47a8-8d5d-99cf43161276 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.046232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1420/2821] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:42.050921 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8265a79-3e30-4e29-bec2-ca25283f98d7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.061236 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8265a79-3e30-4e29-bec2-ca25283f98d7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.066151 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3e794-dea4-4143-8c1a-4d7c02c6ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.067046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3e794-dea4-4143-8c1a-4d7c02c6ed0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.067321 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3e794-dea4-4143-8c1a-4d7c02c6ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.067593 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3e794-dea4-4143-8c1a-4d7c02c6ed0c admin admin] PATH_INFO: `/v3/projects/a9c3083900094afcbf6717ca3494bc15/users/7718904f00fa417795ed29ecc5b6a858/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.082494 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3e794-dea4-4143-8c1a-4d7c02c6ed0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c3083900094afcbf6717ca3494bc15, user_id=7718904f00fa417795ed29ecc5b6a858, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.085186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3e794-dea4-4143-8c1a-4d7c02c6ed0c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.102259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1402/2822] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:42 2022] PUT /identity/v3/projects/a9c3083900094afcbf6717ca3494bc15/users/7718904f00fa417795ed29ecc5b6a858/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:42.106285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac09851-37a5-47a8-8d5d-99cf43161276 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.117007 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac09851-37a5-47a8-8d5d-99cf43161276 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.176108 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5f34b-9144-4db7-aaa8-14446b484ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.176773 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5f34b-9144-4db7-aaa8-14446b484ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.177112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5f34b-9144-4db7-aaa8-14446b484ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.177382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5f34b-9144-4db7-aaa8-14446b484ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.178110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5f34b-9144-4db7-aaa8-14446b484ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.179823 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5f34b-9144-4db7-aaa8-14446b484ac0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.189554 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1421/2823] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:42.193836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3e794-dea4-4143-8c1a-4d7c02c6ed0c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.204377 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3e794-dea4-4143-8c1a-4d7c02c6ed0c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.209168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61d786-9fc5-402b-b2cd-fc839cf6c721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.210060 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61d786-9fc5-402b-b2cd-fc839cf6c721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.210461 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61d786-9fc5-402b-b2cd-fc839cf6c721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.210759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61d786-9fc5-402b-b2cd-fc839cf6c721 admin admin] PATH_INFO: `/v3/projects/a9c3083900094afcbf6717ca3494bc15/users/7718904f00fa417795ed29ecc5b6a858/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.212747 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61d786-9fc5-402b-b2cd-fc839cf6c721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c3083900094afcbf6717ca3494bc15, user_id=7718904f00fa417795ed29ecc5b6a858, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.215441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61d786-9fc5-402b-b2cd-fc839cf6c721 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.221355 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:42.228155 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1403/2824] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:42 2022] PUT /identity/v3/projects/a9c3083900094afcbf6717ca3494bc15/users/7718904f00fa417795ed29ecc5b6a858/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:42.239633 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10799dc5-9243-46c6-8963-f2e7b6d88705 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.239808 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10799dc5-9243-46c6-8963-f2e7b6d88705 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.240116 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10799dc5-9243-46c6-8963-f2e7b6d88705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.266884 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-10799dc5-9243-46c6-8963-f2e7b6d88705 None None] MFA Rules not processed for user `7718904f00fa417795ed29ecc5b6a858`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:42.268096 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-10799dc5-9243-46c6-8963-f2e7b6d88705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:42.337436 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1422/2825] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:42.350865 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61d786-9fc5-402b-b2cd-fc839cf6c721 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.352791 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4d61d786-9fc5-402b-b2cd-fc839cf6c721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:42.410281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61d786-9fc5-402b-b2cd-fc839cf6c721 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.414438 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49cb85-691c-462d-96ec-b17c27f4e439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.415076 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49cb85-691c-462d-96ec-b17c27f4e439 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.415351 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49cb85-691c-462d-96ec-b17c27f4e439 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.415618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49cb85-691c-462d-96ec-b17c27f4e439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.425100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49cb85-691c-462d-96ec-b17c27f4e439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.426528 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49cb85-691c-462d-96ec-b17c27f4e439 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.435963 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1404/2826] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:42.841513 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10799dc5-9243-46c6-8963-f2e7b6d88705 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.858982 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:42.906501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10799dc5-9243-46c6-8963-f2e7b6d88705 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.911772 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.912722 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.912991 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.913294 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] PATH_INFO: `/v3/users/6e1f0907d87c4776aff3cc9e3c568619` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.914645 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1f0907d87c4776aff3cc9e3c568619)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.916610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.966632 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1f0907d87c4776aff3cc9e3c568619'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.979520 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1f0907d87c4776aff3cc9e3c568619'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.980327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1f0907d87c4776aff3cc9e3c568619'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.989196 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1f0907d87c4776aff3cc9e3c568619'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.996148 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1f0907d87c4776aff3cc9e3c568619'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.002348 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1423/2827] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:42 2022] DELETE /identity/v3/users/6e1f0907d87c4776aff3cc9e3c568619 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:43.007184 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f77794-779a-49eb-8ba1-0dc4fef9cc24 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.007475 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f77794-779a-49eb-8ba1-0dc4fef9cc24 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.007754 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f77794-779a-49eb-8ba1-0dc4fef9cc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.026831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-65f77794-779a-49eb-8ba1-0dc4fef9cc24 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:43.028046 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-65f77794-779a-49eb-8ba1-0dc4fef9cc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.089916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1405/2828] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:43.100014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:43.101589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.163217 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f59b7a-d131-40b5-bc03-1bdca4668118 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:43.169771 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a216de-7778-465c-817a-754c5d59a58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:43.170708 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a216de-7778-465c-817a-754c5d59a58b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.171082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a216de-7778-465c-817a-754c5d59a58b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.171434 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a216de-7778-465c-817a-754c5d59a58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.187442 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a216de-7778-465c-817a-754c5d59a58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:43.189727 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a216de-7778-465c-817a-754c5d59a58b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:43.201969 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1424/2829] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:43.474064 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f77794-779a-49eb-8ba1-0dc4fef9cc24 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:43.475674 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-65f77794-779a-49eb-8ba1-0dc4fef9cc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.488018 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f77794-779a-49eb-8ba1-0dc4fef9cc24 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:43.493372 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:43.494304 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.494565 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.494876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] PATH_INFO: `/v3/projects/78671524df674e3fad31f59777520cfb` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.496086 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=78671524df674e3fad31f59777520cfb)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:43.498170 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:43.546098 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78671524df674e3fad31f59777520cfb', 'request_id': 'req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.555517 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78671524df674e3fad31f59777520cfb', 'request_id': 'req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.561465 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78671524df674e3fad31f59777520cfb', 'request_id': 'req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.572633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] The token cache is being invalidate because project 78671524df674e3fad31f59777520cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:43.572920 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.573592 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.575161 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1406/2830] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:43 2022] DELETE /identity/v3/projects/78671524df674e3fad31f59777520cfb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:43.579302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a216de-7778-465c-817a-754c5d59a58b service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:43.589342 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a216de-7778-465c-817a-754c5d59a58b service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:43.624517 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:43.651385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a091b-c88f-4068-9d58-960ceb257508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:43.652331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a091b-c88f-4068-9d58-960ceb257508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.652611 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a091b-c88f-4068-9d58-960ceb257508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.652915 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a091b-c88f-4068-9d58-960ceb257508 admin admin] PATH_INFO: `/v3/users/7718904f00fa417795ed29ecc5b6a858` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.654184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a091b-c88f-4068-9d58-960ceb257508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7718904f00fa417795ed29ecc5b6a858)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:43.657112 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a091b-c88f-4068-9d58-960ceb257508 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:43.712887 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-155a091b-c88f-4068-9d58-960ceb257508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7718904f00fa417795ed29ecc5b6a858'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.725027 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-155a091b-c88f-4068-9d58-960ceb257508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7718904f00fa417795ed29ecc5b6a858'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.725699 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-155a091b-c88f-4068-9d58-960ceb257508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7718904f00fa417795ed29ecc5b6a858'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.734590 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-155a091b-c88f-4068-9d58-960ceb257508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7718904f00fa417795ed29ecc5b6a858'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.741423 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-155a091b-c88f-4068-9d58-960ceb257508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7718904f00fa417795ed29ecc5b6a858'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.747354 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1425/2831] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:43 2022] DELETE /identity/v3/users/7718904f00fa417795ed29ecc5b6a858 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:44.024572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.026114 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:44.040603 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ee6f9-7189-40a7-8641-d809e8a2eebc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.062131 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:44.101307 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.102162 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.102441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.102714 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] PATH_INFO: `/v3/projects/a9c3083900094afcbf6717ca3494bc15` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.103959 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c3083900094afcbf6717ca3494bc15)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.105948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.154787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c3083900094afcbf6717ca3494bc15', 'request_id': 'req-3d7e0698-8056-4a43-8dce-483daf4f1fcb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.163639 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c3083900094afcbf6717ca3494bc15', 'request_id': 'req-3d7e0698-8056-4a43-8dce-483daf4f1fcb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.169401 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c3083900094afcbf6717ca3494bc15', 'request_id': 'req-3d7e0698-8056-4a43-8dce-483daf4f1fcb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.180153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] The token cache is being invalidate because project a9c3083900094afcbf6717ca3494bc15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:44.180433 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.181089 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3d7e0698-8056-4a43-8dce-483daf4f1fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.182618 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1407/2832] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:44 2022] DELETE /identity/v3/projects/a9c3083900094afcbf6717ca3494bc15 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:44.187694 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef82c-20cc-4dbc-b276-10867bb0cb00 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.188164 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef82c-20cc-4dbc-b276-10867bb0cb00 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.188256 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef82c-20cc-4dbc-b276-10867bb0cb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.206676 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-811ef82c-20cc-4dbc-b276-10867bb0cb00 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:44.207895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-811ef82c-20cc-4dbc-b276-10867bb0cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:44.268647 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1426/2833] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:44.276708 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1a421-a310-4fef-a89c-9ab8dd8dd014 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.277023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1a421-a310-4fef-a89c-9ab8dd8dd014 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.277298 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1a421-a310-4fef-a89c-9ab8dd8dd014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.296661 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bdc1a421-a310-4fef-a89c-9ab8dd8dd014 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:44.297897 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bdc1a421-a310-4fef-a89c-9ab8dd8dd014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:44.305981 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1408/2834] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:44.310241 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef82c-20cc-4dbc-b276-10867bb0cb00 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.320284 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef82c-20cc-4dbc-b276-10867bb0cb00 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.325479 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0ab61-760c-42f9-a824-3200e9bda38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.326132 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0ab61-760c-42f9-a824-3200e9bda38c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.326416 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0ab61-760c-42f9-a824-3200e9bda38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.326688 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0ab61-760c-42f9-a824-3200e9bda38c admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.327418 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0ab61-760c-42f9-a824-3200e9bda38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:44.327739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0ab61-760c-42f9-a824-3200e9bda38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.329350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0ab61-760c-42f9-a824-3200e9bda38c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.341054 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1427/2835] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:44.345567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1a421-a310-4fef-a89c-9ab8dd8dd014 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.354703 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1a421-a310-4fef-a89c-9ab8dd8dd014 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.359723 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99128f7a-d6a5-4558-89e9-99b794ef20f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.360360 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99128f7a-d6a5-4558-89e9-99b794ef20f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.360640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99128f7a-d6a5-4558-89e9-99b794ef20f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.360903 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99128f7a-d6a5-4558-89e9-99b794ef20f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.361632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99128f7a-d6a5-4558-89e9-99b794ef20f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.363516 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99128f7a-d6a5-4558-89e9-99b794ef20f7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.392976 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1409/2836] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:44 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:44.397498 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0ab61-760c-42f9-a824-3200e9bda38c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.410214 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0ab61-760c-42f9-a824-3200e9bda38c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.451101 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:44.471029 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf97bf-3135-4b9d-a926-c6c2e99993cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.472374 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf97bf-3135-4b9d-a926-c6c2e99993cb admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.472745 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf97bf-3135-4b9d-a926-c6c2e99993cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.473197 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf97bf-3135-4b9d-a926-c6c2e99993cb admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.474240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf97bf-3135-4b9d-a926-c6c2e99993cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.477351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf97bf-3135-4b9d-a926-c6c2e99993cb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.504260 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1428/2837] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:44 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:44.508496 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99128f7a-d6a5-4558-89e9-99b794ef20f7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.519029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99128f7a-d6a5-4558-89e9-99b794ef20f7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.524000 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a20ce-2b78-4159-a608-b6e91c417ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.524667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a20ce-2b78-4159-a608-b6e91c417ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.524974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a20ce-2b78-4159-a608-b6e91c417ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.525271 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a20ce-2b78-4159-a608-b6e91c417ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.526009 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a20ce-2b78-4159-a608-b6e91c417ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.527605 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a20ce-2b78-4159-a608-b6e91c417ae4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.538241 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1410/2838] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:44.542179 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf97bf-3135-4b9d-a926-c6c2e99993cb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.556455 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf97bf-3135-4b9d-a926-c6c2e99993cb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.561706 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175620e-2733-4b8f-b94a-46b94a81e267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.562392 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175620e-2733-4b8f-b94a-46b94a81e267 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.562700 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175620e-2733-4b8f-b94a-46b94a81e267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.562972 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175620e-2733-4b8f-b94a-46b94a81e267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.563705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175620e-2733-4b8f-b94a-46b94a81e267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.565331 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175620e-2733-4b8f-b94a-46b94a81e267 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.575616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1429/2839] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:44.579836 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a20ce-2b78-4159-a608-b6e91c417ae4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.590021 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a20ce-2b78-4159-a608-b6e91c417ae4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.594781 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb58664-afa1-4c05-a199-d9d147e895a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.596052 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb58664-afa1-4c05-a199-d9d147e895a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.596325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb58664-afa1-4c05-a199-d9d147e895a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.596595 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb58664-afa1-4c05-a199-d9d147e895a2 admin admin] PATH_INFO: `/v3/projects/914f1ae663a9430cbfe315b89026ec1d/users/b1ee5301b2044a34873744a5a2a48f52/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.611606 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb58664-afa1-4c05-a199-d9d147e895a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914f1ae663a9430cbfe315b89026ec1d, user_id=b1ee5301b2044a34873744a5a2a48f52, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.614232 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb58664-afa1-4c05-a199-d9d147e895a2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.630713 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1411/2840] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:44 2022] PUT /identity/v3/projects/914f1ae663a9430cbfe315b89026ec1d/users/b1ee5301b2044a34873744a5a2a48f52/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:44.641177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5172b9-5b13-4b93-9ef3-26be11ccfa95 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.641466 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5172b9-5b13-4b93-9ef3-26be11ccfa95 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.641736 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5172b9-5b13-4b93-9ef3-26be11ccfa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.668683 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cc5172b9-5b13-4b93-9ef3-26be11ccfa95 None None] MFA Rules not processed for user `b1ee5301b2044a34873744a5a2a48f52`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:44.669915 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cc5172b9-5b13-4b93-9ef3-26be11ccfa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:44.738023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1430/2841] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:44.744349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb58664-afa1-4c05-a199-d9d147e895a2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.807796 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:44.821103 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb58664-afa1-4c05-a199-d9d147e895a2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.827884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66ba08-8a8f-4093-b82a-13d7a3d9736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.828995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66ba08-8a8f-4093-b82a-13d7a3d9736d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.828995 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66ba08-8a8f-4093-b82a-13d7a3d9736d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.829198 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66ba08-8a8f-4093-b82a-13d7a3d9736d admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.829830 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66ba08-8a8f-4093-b82a-13d7a3d9736d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.831739 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66ba08-8a8f-4093-b82a-13d7a3d9736d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.859359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1412/2842] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:44 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:44.863607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5172b9-5b13-4b93-9ef3-26be11ccfa95 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.874896 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5172b9-5b13-4b93-9ef3-26be11ccfa95 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.938383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff4f28-de0c-4053-8580-2043f6d6eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.939046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff4f28-de0c-4053-8580-2043f6d6eae5 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.939322 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff4f28-de0c-4053-8580-2043f6d6eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.939620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff4f28-de0c-4053-8580-2043f6d6eae5 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.940299 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff4f28-de0c-4053-8580-2043f6d6eae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.942249 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff4f28-de0c-4053-8580-2043f6d6eae5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.964239 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1431/2843] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:44 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:44.968445 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66ba08-8a8f-4093-b82a-13d7a3d9736d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.979530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66ba08-8a8f-4093-b82a-13d7a3d9736d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.984400 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17ef3-0b97-423a-a197-f1ab2e7e31d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.985090 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17ef3-0b97-423a-a197-f1ab2e7e31d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.985369 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17ef3-0b97-423a-a197-f1ab2e7e31d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.985638 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17ef3-0b97-423a-a197-f1ab2e7e31d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.986402 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d17ef3-0b97-423a-a197-f1ab2e7e31d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.987980 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d17ef3-0b97-423a-a197-f1ab2e7e31d3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.998652 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1413/2844] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:45.002692 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff4f28-de0c-4053-8580-2043f6d6eae5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:45.013347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff4f28-de0c-4053-8580-2043f6d6eae5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.018494 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad373-0351-4a10-8dfa-182ca82e0647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.019383 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad373-0351-4a10-8dfa-182ca82e0647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.019665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad373-0351-4a10-8dfa-182ca82e0647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.019942 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad373-0351-4a10-8dfa-182ca82e0647 admin admin] PATH_INFO: `/v3/projects/14357e99e22c420db7f08cc044ed6241/users/b31de473809443d1ac5f37d9c7c7e2ac/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.034589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ad373-0351-4a10-8dfa-182ca82e0647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14357e99e22c420db7f08cc044ed6241, user_id=b31de473809443d1ac5f37d9c7c7e2ac, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.037265 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ad373-0351-4a10-8dfa-182ca82e0647 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.051897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1432/2845] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:45 2022] PUT /identity/v3/projects/14357e99e22c420db7f08cc044ed6241/users/b31de473809443d1ac5f37d9c7c7e2ac/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:45.056269 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17ef3-0b97-423a-a197-f1ab2e7e31d3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:45.066509 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17ef3-0b97-423a-a197-f1ab2e7e31d3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.126764 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055ab99-4474-4724-90b1-9b5c71a47f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.127356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055ab99-4474-4724-90b1-9b5c71a47f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.127631 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055ab99-4474-4724-90b1-9b5c71a47f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.127928 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055ab99-4474-4724-90b1-9b5c71a47f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.128641 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055ab99-4474-4724-90b1-9b5c71a47f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.130337 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055ab99-4474-4724-90b1-9b5c71a47f33 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.143566 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1414/2846] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:45.147821 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad373-0351-4a10-8dfa-182ca82e0647 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:45.162834 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad373-0351-4a10-8dfa-182ca82e0647 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.174770 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be086006-7415-4366-8b60-aaa06f22dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.175680 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be086006-7415-4366-8b60-aaa06f22dd34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.175964 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be086006-7415-4366-8b60-aaa06f22dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.176240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be086006-7415-4366-8b60-aaa06f22dd34 admin admin] PATH_INFO: `/v3/projects/14357e99e22c420db7f08cc044ed6241/users/b31de473809443d1ac5f37d9c7c7e2ac/roles/7ca953399e6f45258ff0a470ee4e5f7a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.178532 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be086006-7415-4366-8b60-aaa06f22dd34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14357e99e22c420db7f08cc044ed6241, user_id=b31de473809443d1ac5f37d9c7c7e2ac, role_id=7ca953399e6f45258ff0a470ee4e5f7a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.181438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be086006-7415-4366-8b60-aaa06f22dd34 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.194264 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1433/2847] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:45 2022] PUT /identity/v3/projects/14357e99e22c420db7f08cc044ed6241/users/b31de473809443d1ac5f37d9c7c7e2ac/roles/7ca953399e6f45258ff0a470ee4e5f7a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:45.264020 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc902ef-dad9-40b6-ae95-a5704a63c242 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.264441 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc902ef-dad9-40b6-ae95-a5704a63c242 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.264876 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc902ef-dad9-40b6-ae95-a5704a63c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.295396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cdc902ef-dad9-40b6-ae95-a5704a63c242 None None] MFA Rules not processed for user `b31de473809443d1ac5f37d9c7c7e2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:45.296600 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cdc902ef-dad9-40b6-ae95-a5704a63c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:45.368690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1415/2848] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:45.379705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be086006-7415-4366-8b60-aaa06f22dd34 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:45.381359 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-be086006-7415-4366-8b60-aaa06f22dd34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:45.388730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:45.443572 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be086006-7415-4366-8b60-aaa06f22dd34 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.447665 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82256323-f8c7-48f3-9d56-17918bd43604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.448302 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82256323-f8c7-48f3-9d56-17918bd43604 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.448578 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82256323-f8c7-48f3-9d56-17918bd43604 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.448849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82256323-f8c7-48f3-9d56-17918bd43604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.459837 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82256323-f8c7-48f3-9d56-17918bd43604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.461429 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82256323-f8c7-48f3-9d56-17918bd43604 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.471819 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1434/2849] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:46.039339 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc902ef-dad9-40b6-ae95-a5704a63c242 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:46.091106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:46.107780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc902ef-dad9-40b6-ae95-a5704a63c242 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:46.113204 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:46.114085 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:46.114358 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:46.114623 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] PATH_INFO: `/v3/users/b1ee5301b2044a34873744a5a2a48f52` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:46.115839 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ee5301b2044a34873744a5a2a48f52)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:46.117792 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:46.168048 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ee5301b2044a34873744a5a2a48f52'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.179630 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ee5301b2044a34873744a5a2a48f52'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.180292 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ee5301b2044a34873744a5a2a48f52'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.180899 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ee5301b2044a34873744a5a2a48f52'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.190281 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ee5301b2044a34873744a5a2a48f52'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.203345 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1416/2850] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:46 2022] DELETE /identity/v3/users/b1ee5301b2044a34873744a5a2a48f52 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:46.208036 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430831-b68a-4194-af7a-a37a4d922fe4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:46.208544 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430831-b68a-4194-af7a-a37a4d922fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:46.208651 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430831-b68a-4194-af7a-a37a4d922fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:46.227049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ef430831-b68a-4194-af7a-a37a4d922fe4 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:46.228335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ef430831-b68a-4194-af7a-a37a4d922fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:46.289618 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1435/2851] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:46.299316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:46.300886 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:46.360821 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8df3b-370d-4a93-8186-4eea1e623bfd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:46.365655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62326f16-01a6-4da8-ab85-d3fb8550214c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:46.366396 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62326f16-01a6-4da8-ab85-d3fb8550214c service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:46.366729 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62326f16-01a6-4da8-ab85-d3fb8550214c service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:46.367042 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62326f16-01a6-4da8-ab85-d3fb8550214c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:46.376733 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62326f16-01a6-4da8-ab85-d3fb8550214c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:46.378219 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62326f16-01a6-4da8-ab85-d3fb8550214c service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:46.387487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1417/2852] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:46.665131 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430831-b68a-4194-af7a-a37a4d922fe4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:46.666713 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ef430831-b68a-4194-af7a-a37a4d922fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:46.679046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430831-b68a-4194-af7a-a37a4d922fe4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:46.686417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:46.687371 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:46.687617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:46.687899 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] PATH_INFO: `/v3/projects/914f1ae663a9430cbfe315b89026ec1d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:46.689287 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914f1ae663a9430cbfe315b89026ec1d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:46.691240 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:46.741481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914f1ae663a9430cbfe315b89026ec1d', 'request_id': 'req-686caacb-24da-4daf-88bd-3ce06e80ecc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.751467 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914f1ae663a9430cbfe315b89026ec1d', 'request_id': 'req-686caacb-24da-4daf-88bd-3ce06e80ecc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.757012 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914f1ae663a9430cbfe315b89026ec1d', 'request_id': 'req-686caacb-24da-4daf-88bd-3ce06e80ecc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.767732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] The token cache is being invalidate because project 914f1ae663a9430cbfe315b89026ec1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:46.768016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.768643 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.770191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1436/2853] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:46 2022] DELETE /identity/v3/projects/914f1ae663a9430cbfe315b89026ec1d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:46.774979 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62326f16-01a6-4da8-ab85-d3fb8550214c service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:46.790831 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62326f16-01a6-4da8-ab85-d3fb8550214c service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:46.849859 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74b7cb-dd5e-45e9-b15d-b5f316195a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:46.850740 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74b7cb-dd5e-45e9-b15d-b5f316195a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:46.851015 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74b7cb-dd5e-45e9-b15d-b5f316195a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:46.851283 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74b7cb-dd5e-45e9-b15d-b5f316195a54 admin admin] PATH_INFO: `/v3/users/b31de473809443d1ac5f37d9c7c7e2ac` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:46.852577 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74b7cb-dd5e-45e9-b15d-b5f316195a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31de473809443d1ac5f37d9c7c7e2ac)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:46.855519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74b7cb-dd5e-45e9-b15d-b5f316195a54 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:46.867206 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:46.906894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f74b7cb-dd5e-45e9-b15d-b5f316195a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31de473809443d1ac5f37d9c7c7e2ac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.919223 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f74b7cb-dd5e-45e9-b15d-b5f316195a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31de473809443d1ac5f37d9c7c7e2ac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.920008 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f74b7cb-dd5e-45e9-b15d-b5f316195a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31de473809443d1ac5f37d9c7c7e2ac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.920774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f74b7cb-dd5e-45e9-b15d-b5f316195a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31de473809443d1ac5f37d9c7c7e2ac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.929992 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f74b7cb-dd5e-45e9-b15d-b5f316195a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31de473809443d1ac5f37d9c7c7e2ac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.944235 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1418/2854] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:46 2022] DELETE /identity/v3/users/b31de473809443d1ac5f37d9c7c7e2ac => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:47.232663 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.234195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:47.247583 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686caacb-24da-4daf-88bd-3ce06e80ecc4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.276780 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:47.305327 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.306184 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.306460 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.306732 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] PATH_INFO: `/v3/projects/14357e99e22c420db7f08cc044ed6241` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.307917 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14357e99e22c420db7f08cc044ed6241)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.309846 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.358606 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14357e99e22c420db7f08cc044ed6241', 'request_id': 'req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:47.368351 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14357e99e22c420db7f08cc044ed6241', 'request_id': 'req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:47.374739 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14357e99e22c420db7f08cc044ed6241', 'request_id': 'req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:47.386585 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] The token cache is being invalidate because project 14357e99e22c420db7f08cc044ed6241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:47.386880 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:47.387705 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-cc05325e-543a-423c-bb7f-5ff2a6ea3d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:47.389646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1437/2855] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:47 2022] DELETE /identity/v3/projects/14357e99e22c420db7f08cc044ed6241 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:47.394613 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa321-9584-4e4f-a58f-3fe597dea4a3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.395088 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa321-9584-4e4f-a58f-3fe597dea4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.395213 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa321-9584-4e4f-a58f-3fe597dea4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.414125 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0c6fa321-9584-4e4f-a58f-3fe597dea4a3 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:47.415348 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0c6fa321-9584-4e4f-a58f-3fe597dea4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:47.479132 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1419/2856] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:47.487928 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c911167-d4d0-4f6c-aee9-33af95247a3a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.488234 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c911167-d4d0-4f6c-aee9-33af95247a3a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.488533 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c911167-d4d0-4f6c-aee9-33af95247a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.509998 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9c911167-d4d0-4f6c-aee9-33af95247a3a None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:47.511198 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9c911167-d4d0-4f6c-aee9-33af95247a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:47.519733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1438/2857] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:47.524894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fa321-9584-4e4f-a58f-3fe597dea4a3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.534999 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fa321-9584-4e4f-a58f-3fe597dea4a3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.540669 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219665ca-42af-4da4-b5a7-4c0915bda185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.541362 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219665ca-42af-4da4-b5a7-4c0915bda185 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.541640 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219665ca-42af-4da4-b5a7-4c0915bda185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.541916 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219665ca-42af-4da4-b5a7-4c0915bda185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.542644 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219665ca-42af-4da4-b5a7-4c0915bda185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:47.542948 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219665ca-42af-4da4-b5a7-4c0915bda185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.544558 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219665ca-42af-4da4-b5a7-4c0915bda185 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.557265 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1420/2858] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:47.561502 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c911167-d4d0-4f6c-aee9-33af95247a3a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.570765 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c911167-d4d0-4f6c-aee9-33af95247a3a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.575686 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705b4f7-470a-4141-8b05-9e436e5a53e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.576330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705b4f7-470a-4141-8b05-9e436e5a53e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.576607 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705b4f7-470a-4141-8b05-9e436e5a53e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.576881 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705b4f7-470a-4141-8b05-9e436e5a53e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.577610 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705b4f7-470a-4141-8b05-9e436e5a53e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.579503 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705b4f7-470a-4141-8b05-9e436e5a53e3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.608191 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1439/2859] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:47 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:47.613027 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219665ca-42af-4da4-b5a7-4c0915bda185 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.624994 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219665ca-42af-4da4-b5a7-4c0915bda185 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.681879 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f97d5b-59dc-4cfb-88c0-40f722d421cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.682545 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f97d5b-59dc-4cfb-88c0-40f722d421cf admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.682825 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f97d5b-59dc-4cfb-88c0-40f722d421cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.683093 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f97d5b-59dc-4cfb-88c0-40f722d421cf admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.683784 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f97d5b-59dc-4cfb-88c0-40f722d421cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.685755 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f97d5b-59dc-4cfb-88c0-40f722d421cf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.706687 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1421/2860] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:47 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:47.710992 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705b4f7-470a-4141-8b05-9e436e5a53e3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.722347 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705b4f7-470a-4141-8b05-9e436e5a53e3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.728509 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ae9a7-ee46-47db-8ebc-03052c6cc6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.729195 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae9a7-ee46-47db-8ebc-03052c6cc6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.729448 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae9a7-ee46-47db-8ebc-03052c6cc6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.729725 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae9a7-ee46-47db-8ebc-03052c6cc6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.730461 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ae9a7-ee46-47db-8ebc-03052c6cc6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.732071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ae9a7-ee46-47db-8ebc-03052c6cc6b4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.743350 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1440/2861] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:47.748079 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f97d5b-59dc-4cfb-88c0-40f722d421cf admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.758295 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:47.762493 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f97d5b-59dc-4cfb-88c0-40f722d421cf admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.769346 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81d2aa-3d6c-4830-ab1d-35c771f3c0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.770024 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d2aa-3d6c-4830-ab1d-35c771f3c0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.770530 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d2aa-3d6c-4830-ab1d-35c771f3c0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.770993 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d2aa-3d6c-4830-ab1d-35c771f3c0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.771934 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81d2aa-3d6c-4830-ab1d-35c771f3c0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.773561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81d2aa-3d6c-4830-ab1d-35c771f3c0b9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.783894 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1422/2862] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:47.788176 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ae9a7-ee46-47db-8ebc-03052c6cc6b4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.800079 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ae9a7-ee46-47db-8ebc-03052c6cc6b4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.806180 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb608ac-ce1d-4694-8e18-ce9e01280ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.807733 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb608ac-ce1d-4694-8e18-ce9e01280ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.808016 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb608ac-ce1d-4694-8e18-ce9e01280ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.808387 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb608ac-ce1d-4694-8e18-ce9e01280ce8 admin admin] PATH_INFO: `/v3/projects/285adfb5a0b143e8972d0daac7ac3ec0/users/b1d9f603a52c43f48ff6808a09a1a6d1/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.830046 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb608ac-ce1d-4694-8e18-ce9e01280ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285adfb5a0b143e8972d0daac7ac3ec0, user_id=b1d9f603a52c43f48ff6808a09a1a6d1, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.832728 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb608ac-ce1d-4694-8e18-ce9e01280ce8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.849104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1441/2863] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:47 2022] PUT /identity/v3/projects/285adfb5a0b143e8972d0daac7ac3ec0/users/b1d9f603a52c43f48ff6808a09a1a6d1/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:47.861119 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bc6f8-0d46-43ee-993d-61053e29744f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.861397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bc6f8-0d46-43ee-993d-61053e29744f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.861666 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bc6f8-0d46-43ee-993d-61053e29744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.889403 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f45bc6f8-0d46-43ee-993d-61053e29744f None None] MFA Rules not processed for user `b1d9f603a52c43f48ff6808a09a1a6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:47.890622 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f45bc6f8-0d46-43ee-993d-61053e29744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:47.956084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1423/2864] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:47.967609 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb608ac-ce1d-4694-8e18-ce9e01280ce8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.969541 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dcb608ac-ce1d-4694-8e18-ce9e01280ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.029128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb608ac-ce1d-4694-8e18-ce9e01280ce8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:48.033098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba842fcf-6526-4475-9309-ee22a1ab5cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:48.033743 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842fcf-6526-4475-9309-ee22a1ab5cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.034015 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842fcf-6526-4475-9309-ee22a1ab5cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.034286 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842fcf-6526-4475-9309-ee22a1ab5cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.042807 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba842fcf-6526-4475-9309-ee22a1ab5cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:48.044255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba842fcf-6526-4475-9309-ee22a1ab5cb9 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:48.048756 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:48.053582 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1442/2865] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:48.072923 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bc6f8-0d46-43ee-993d-61053e29744f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:48.145692 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bc6f8-0d46-43ee-993d-61053e29744f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:48.150793 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:48.151688 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.151964 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.152233 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] PATH_INFO: `/v3/users/b1d9f603a52c43f48ff6808a09a1a6d1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.153492 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d9f603a52c43f48ff6808a09a1a6d1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:48.155416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:48.210413 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d9f603a52c43f48ff6808a09a1a6d1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.223118 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d9f603a52c43f48ff6808a09a1a6d1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.223787 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d9f603a52c43f48ff6808a09a1a6d1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.224412 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d9f603a52c43f48ff6808a09a1a6d1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.233684 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d9f603a52c43f48ff6808a09a1a6d1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.246540 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1424/2866] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:48 2022] DELETE /identity/v3/users/b1d9f603a52c43f48ff6808a09a1a6d1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:48.251229 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f724ab2-158a-4c3c-8929-06139c0aeaf0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.251748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f724ab2-158a-4c3c-8929-06139c0aeaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.251748 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f724ab2-158a-4c3c-8929-06139c0aeaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.269857 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5f724ab2-158a-4c3c-8929-06139c0aeaf0 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:48.271078 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5f724ab2-158a-4c3c-8929-06139c0aeaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.331438 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1443/2867] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:48.341748 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:48.343397 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.349704 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:48.405440 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055fa94-29d4-4bae-bb29-b791be7b33ac admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:48.409567 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3e9ed-a9c5-43c6-83d7-3a43b3babb17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:48.410211 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3e9ed-a9c5-43c6-83d7-3a43b3babb17 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.410487 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3e9ed-a9c5-43c6-83d7-3a43b3babb17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.410759 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3e9ed-a9c5-43c6-83d7-3a43b3babb17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.420359 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3e9ed-a9c5-43c6-83d7-3a43b3babb17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:48.421809 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3e9ed-a9c5-43c6-83d7-3a43b3babb17 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:48.431312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1425/2868] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:48.705326 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f724ab2-158a-4c3c-8929-06139c0aeaf0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:48.706781 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5f724ab2-158a-4c3c-8929-06139c0aeaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.725082 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f724ab2-158a-4c3c-8929-06139c0aeaf0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:48.731445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:48.732334 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.732617 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.732895 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] PATH_INFO: `/v3/projects/285adfb5a0b143e8972d0daac7ac3ec0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.734223 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285adfb5a0b143e8972d0daac7ac3ec0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:48.736156 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:48.785090 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285adfb5a0b143e8972d0daac7ac3ec0', 'request_id': 'req-d1785d44-fa8c-4ceb-8dd0-3595676090f6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.793935 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285adfb5a0b143e8972d0daac7ac3ec0', 'request_id': 'req-d1785d44-fa8c-4ceb-8dd0-3595676090f6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.799985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285adfb5a0b143e8972d0daac7ac3ec0', 'request_id': 'req-d1785d44-fa8c-4ceb-8dd0-3595676090f6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.811655 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] The token cache is being invalidate because project 285adfb5a0b143e8972d0daac7ac3ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:48.811937 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.812616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d1785d44-fa8c-4ceb-8dd0-3595676090f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.814206 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1444/2869] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:48 2022] DELETE /identity/v3/projects/285adfb5a0b143e8972d0daac7ac3ec0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:48.819349 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b0810-49b2-4bf8-b9fb-379736846eec None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.819632 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b0810-49b2-4bf8-b9fb-379736846eec None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.819937 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b0810-49b2-4bf8-b9fb-379736846eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.838682 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1b9b0810-49b2-4bf8-b9fb-379736846eec None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:48.839820 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1b9b0810-49b2-4bf8-b9fb-379736846eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.912047 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1426/2870] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:48.920014 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fccdf7-0b60-4ae8-8ab0-ddac59d0747b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.920320 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fccdf7-0b60-4ae8-8ab0-ddac59d0747b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.920595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fccdf7-0b60-4ae8-8ab0-ddac59d0747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.939023 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f0fccdf7-0b60-4ae8-8ab0-ddac59d0747b None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:48.940209 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f0fccdf7-0b60-4ae8-8ab0-ddac59d0747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.948414 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1445/2871] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:48.952588 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b0810-49b2-4bf8-b9fb-379736846eec None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:48.962654 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b0810-49b2-4bf8-b9fb-379736846eec None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:48.968043 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba716c9d-ede4-44ec-995f-b2d29aded065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:48.968696 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba716c9d-ede4-44ec-995f-b2d29aded065 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.968987 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba716c9d-ede4-44ec-995f-b2d29aded065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.969291 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba716c9d-ede4-44ec-995f-b2d29aded065 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.970032 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba716c9d-ede4-44ec-995f-b2d29aded065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:48.970343 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba716c9d-ede4-44ec-995f-b2d29aded065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:48.972308 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba716c9d-ede4-44ec-995f-b2d29aded065 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:48.984312 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1427/2872] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:48.988902 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fccdf7-0b60-4ae8-8ab0-ddac59d0747b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:48.998417 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fccdf7-0b60-4ae8-8ab0-ddac59d0747b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.004097 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317a1e-6081-44e4-8a1e-f5548397ad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.004760 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317a1e-6081-44e4-8a1e-f5548397ad34 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.005083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317a1e-6081-44e4-8a1e-f5548397ad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.005358 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317a1e-6081-44e4-8a1e-f5548397ad34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.006049 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3317a1e-6081-44e4-8a1e-f5548397ad34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.007952 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3317a1e-6081-44e4-8a1e-f5548397ad34 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.036534 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1446/2873] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:48 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:42:49.042168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba716c9d-ede4-44ec-995f-b2d29aded065 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.053773 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba716c9d-ede4-44ec-995f-b2d29aded065 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.119358 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71020f3-264d-49a4-bc43-305df3904bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.119957 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71020f3-264d-49a4-bc43-305df3904bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.120296 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71020f3-264d-49a4-bc43-305df3904bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.120571 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71020f3-264d-49a4-bc43-305df3904bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.121319 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71020f3-264d-49a4-bc43-305df3904bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.123259 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71020f3-264d-49a4-bc43-305df3904bf7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.144790 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1428/2874] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:49 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:42:49.149496 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317a1e-6081-44e4-8a1e-f5548397ad34 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.165501 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317a1e-6081-44e4-8a1e-f5548397ad34 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.171377 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f19e5-d957-4628-a672-3664874b8181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.172044 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f19e5-d957-4628-a672-3664874b8181 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.172324 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f19e5-d957-4628-a672-3664874b8181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.172595 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f19e5-d957-4628-a672-3664874b8181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.173366 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f19e5-d957-4628-a672-3664874b8181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.174970 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f19e5-d957-4628-a672-3664874b8181 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.187497 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1447/2875] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:49.193655 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71020f3-264d-49a4-bc43-305df3904bf7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.210350 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71020f3-264d-49a4-bc43-305df3904bf7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.219804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f41f7-4702-451f-b0e2-2fdcd5af531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.220751 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f41f7-4702-451f-b0e2-2fdcd5af531f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.221512 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f41f7-4702-451f-b0e2-2fdcd5af531f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.221848 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f41f7-4702-451f-b0e2-2fdcd5af531f admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.222917 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f41f7-4702-451f-b0e2-2fdcd5af531f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.225468 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f41f7-4702-451f-b0e2-2fdcd5af531f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.236765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1429/2876] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:49.242166 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f19e5-d957-4628-a672-3664874b8181 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.255144 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f19e5-d957-4628-a672-3664874b8181 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.261254 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cd67e-0461-4905-8286-15aaa8d459bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.262178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cd67e-0461-4905-8286-15aaa8d459bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.262481 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cd67e-0461-4905-8286-15aaa8d459bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.262740 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cd67e-0461-4905-8286-15aaa8d459bc admin admin] PATH_INFO: `/v3/projects/6d27d92e11404ded865458afb3a0c65f/users/77679e4cc99f4180a24222d83353b0a9/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.278669 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cd67e-0461-4905-8286-15aaa8d459bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d27d92e11404ded865458afb3a0c65f, user_id=77679e4cc99f4180a24222d83353b0a9, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.281385 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cd67e-0461-4905-8286-15aaa8d459bc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.298118 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1448/2877] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:49 2022] PUT /identity/v3/projects/6d27d92e11404ded865458afb3a0c65f/users/77679e4cc99f4180a24222d83353b0a9/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:49.309495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32640d8-9f06-4a02-ad22-62c2e60b58f6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.309843 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32640d8-9f06-4a02-ad22-62c2e60b58f6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.310186 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32640d8-9f06-4a02-ad22-62c2e60b58f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.333958 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:49.342884 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c32640d8-9f06-4a02-ad22-62c2e60b58f6 None None] MFA Rules not processed for user `77679e4cc99f4180a24222d83353b0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:49.344586 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c32640d8-9f06-4a02-ad22-62c2e60b58f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:49.410316 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1430/2878] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:42:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:49.421741 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cd67e-0461-4905-8286-15aaa8d459bc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.423490 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d31cd67e-0461-4905-8286-15aaa8d459bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:49.445576 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:49.481365 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cd67e-0461-4905-8286-15aaa8d459bc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.485128 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18958ef0-f6ab-4b3d-ab96-6834d7cbe870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.485774 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18958ef0-f6ab-4b3d-ab96-6834d7cbe870 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.486056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18958ef0-f6ab-4b3d-ab96-6834d7cbe870 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.486332 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18958ef0-f6ab-4b3d-ab96-6834d7cbe870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.495045 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18958ef0-f6ab-4b3d-ab96-6834d7cbe870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.496477 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18958ef0-f6ab-4b3d-ab96-6834d7cbe870 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.505519 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1449/2879] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:59.407572 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=27 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:59.501382 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=17 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:23.694863 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32640d8-9f06-4a02-ad22-62c2e60b58f6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:23.800016 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32640d8-9f06-4a02-ad22-62c2e60b58f6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:23.805072 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:23.805975 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:23.806251 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:23.806519 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] PATH_INFO: `/v3/users/77679e4cc99f4180a24222d83353b0a9` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:23.807770 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77679e4cc99f4180a24222d83353b0a9)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:23.809724 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:23.860031 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77679e4cc99f4180a24222d83353b0a9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:23.872100 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77679e4cc99f4180a24222d83353b0a9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:23.872774 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77679e4cc99f4180a24222d83353b0a9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:23.873405 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77679e4cc99f4180a24222d83353b0a9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:23.881846 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77679e4cc99f4180a24222d83353b0a9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:23.894139 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1431/2880] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:43:23 2022] DELETE /identity/v3/users/77679e4cc99f4180a24222d83353b0a9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:23.898897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6379cb5-6e7b-44ea-8d69-068d5e2579b1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:23.899408 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6379cb5-6e7b-44ea-8d69-068d5e2579b1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:23.899518 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6379cb5-6e7b-44ea-8d69-068d5e2579b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:23.946985 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e6379cb5-6e7b-44ea-8d69-068d5e2579b1 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:23.948094 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6379cb5-6e7b-44ea-8d69-068d5e2579b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:24.009470 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1450/2881] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:24.019368 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:24.021023 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:24.064416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:24.123008 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812267b-e7d2-48ce-a0b3-7aef763c3fe6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:24.127561 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bbdca-22d6-415a-a289-befc1304455a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:24.128222 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bbdca-22d6-415a-a289-befc1304455a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.128504 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bbdca-22d6-415a-a289-befc1304455a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.128780 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bbdca-22d6-415a-a289-befc1304455a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.138541 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bbdca-22d6-415a-a289-befc1304455a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:24.139974 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bbdca-22d6-415a-a289-befc1304455a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:24.149798 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1432/2882] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:24.426071 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6379cb5-6e7b-44ea-8d69-068d5e2579b1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:24.427711 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6379cb5-6e7b-44ea-8d69-068d5e2579b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:24.440620 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6379cb5-6e7b-44ea-8d69-068d5e2579b1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:24.446646 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:24.447543 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.447822 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.448091 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] PATH_INFO: `/v3/projects/6d27d92e11404ded865458afb3a0c65f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.449445 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d27d92e11404ded865458afb3a0c65f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:24.451362 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:24.503088 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d27d92e11404ded865458afb3a0c65f', 'request_id': 'req-49566170-502c-40bf-9522-ad7c44d52f4f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:24.512268 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d27d92e11404ded865458afb3a0c65f', 'request_id': 'req-49566170-502c-40bf-9522-ad7c44d52f4f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:24.518032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d27d92e11404ded865458afb3a0c65f', 'request_id': 'req-49566170-502c-40bf-9522-ad7c44d52f4f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:24.528930 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] The token cache is being invalidate because project 6d27d92e11404ded865458afb3a0c65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:43:24.529255 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:24.529915 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-49566170-502c-40bf-9522-ad7c44d52f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:24.531604 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1451/2883] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:43:24 2022] DELETE /identity/v3/projects/6d27d92e11404ded865458afb3a0c65f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:24.536653 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843762a-e893-4cdc-bc4d-68d7e9457237 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.537075 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843762a-e893-4cdc-bc4d-68d7e9457237 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.537356 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843762a-e893-4cdc-bc4d-68d7e9457237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.576175 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3843762a-e893-4cdc-bc4d-68d7e9457237 None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:24.577430 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3843762a-e893-4cdc-bc4d-68d7e9457237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:24.637877 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1433/2884] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:24.645844 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445661-18fe-4377-9638-311c0341aa2c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.646131 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445661-18fe-4377-9638-311c0341aa2c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.646401 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445661-18fe-4377-9638-311c0341aa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.666697 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-51445661-18fe-4377-9638-311c0341aa2c None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:24.667894 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-51445661-18fe-4377-9638-311c0341aa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:24.677058 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1452/2885] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:24.681249 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843762a-e893-4cdc-bc4d-68d7e9457237 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:24.691094 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843762a-e893-4cdc-bc4d-68d7e9457237 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:24.696192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cecc6-ebdf-417b-9c03-cae7ea121a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:24.696873 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cecc6-ebdf-417b-9c03-cae7ea121a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.697142 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cecc6-ebdf-417b-9c03-cae7ea121a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.697416 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cecc6-ebdf-417b-9c03-cae7ea121a9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.698153 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cecc6-ebdf-417b-9c03-cae7ea121a9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:43:24.698469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cecc6-ebdf-417b-9c03-cae7ea121a9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:24.700084 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cecc6-ebdf-417b-9c03-cae7ea121a9d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:24.711812 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1434/2886] 10.222.0.30 () {58 vars in 1152 bytes} [Wed Jul 6 20:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:43:24.716330 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51445661-18fe-4377-9638-311c0341aa2c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:24.726110 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51445661-18fe-4377-9638-311c0341aa2c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:24.731990 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844b71f-8c8d-4609-ae61-81da902213eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:24.732630 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844b71f-8c8d-4609-ae61-81da902213eb admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.732931 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844b71f-8c8d-4609-ae61-81da902213eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.733232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844b71f-8c8d-4609-ae61-81da902213eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.733977 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844b71f-8c8d-4609-ae61-81da902213eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:24.735934 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844b71f-8c8d-4609-ae61-81da902213eb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:24.764307 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1453/2887] 10.222.0.30 () {60 vars in 1152 bytes} [Wed Jul 6 20:43:24 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:43:24.768266 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cecc6-ebdf-417b-9c03-cae7ea121a9d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:24.778574 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cecc6-ebdf-417b-9c03-cae7ea121a9d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:24.835720 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eef0ee-c84b-4337-98e4-f6ed20308261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:24.836428 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eef0ee-c84b-4337-98e4-f6ed20308261 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.836707 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eef0ee-c84b-4337-98e4-f6ed20308261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.836986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eef0ee-c84b-4337-98e4-f6ed20308261 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.837707 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eef0ee-c84b-4337-98e4-f6ed20308261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:24.839633 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eef0ee-c84b-4337-98e4-f6ed20308261 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:24.864342 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1435/2888] 10.222.0.30 () {60 vars in 1143 bytes} [Wed Jul 6 20:43:24 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:43:24.868734 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844b71f-8c8d-4609-ae61-81da902213eb admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:24.879724 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844b71f-8c8d-4609-ae61-81da902213eb admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:24.884783 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4e131-a48f-408d-b3d0-b37c28e8a550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:24.885565 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4e131-a48f-408d-b3d0-b37c28e8a550 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.885849 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4e131-a48f-408d-b3d0-b37c28e8a550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.886118 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4e131-a48f-408d-b3d0-b37c28e8a550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.886848 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4e131-a48f-408d-b3d0-b37c28e8a550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:24.888424 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4e131-a48f-408d-b3d0-b37c28e8a550 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:24.899133 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1454/2889] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:43:24.903325 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eef0ee-c84b-4337-98e4-f6ed20308261 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:24.913978 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eef0ee-c84b-4337-98e4-f6ed20308261 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:24.918892 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6649f-e32e-4800-9dac-53aa99ee3d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:24.919554 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6649f-e32e-4800-9dac-53aa99ee3d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.919833 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6649f-e32e-4800-9dac-53aa99ee3d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.920106 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6649f-e32e-4800-9dac-53aa99ee3d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.920943 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6649f-e32e-4800-9dac-53aa99ee3d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:24.922626 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6649f-e32e-4800-9dac-53aa99ee3d21 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:24.923880 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:24.934765 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1436/2890] 10.222.0.30 () {58 vars in 1121 bytes} [Wed Jul 6 20:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:43:24.938933 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4e131-a48f-408d-b3d0-b37c28e8a550 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:24.948897 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4e131-a48f-408d-b3d0-b37c28e8a550 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:24.953616 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8905d-ae56-4354-bfdf-532ea7175537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:24.954488 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8905d-ae56-4354-bfdf-532ea7175537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.954763 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8905d-ae56-4354-bfdf-532ea7175537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.955032 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8905d-ae56-4354-bfdf-532ea7175537 admin admin] PATH_INFO: `/v3/projects/2a06b3d80edd4f558bccbb4927a8b316/users/f2f1b700b44b4fe8913feb4489718433/roles/0997a26e1c354ef5b0c2730f761b47ed` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.969309 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8905d-ae56-4354-bfdf-532ea7175537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a06b3d80edd4f558bccbb4927a8b316, user_id=f2f1b700b44b4fe8913feb4489718433, role_id=0997a26e1c354ef5b0c2730f761b47ed)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:24.972068 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8905d-ae56-4354-bfdf-532ea7175537 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:24.974285 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:24.988232 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1455/2891] 10.222.0.30 () {60 vars in 1482 bytes} [Wed Jul 6 20:43:24 2022] PUT /identity/v3/projects/2a06b3d80edd4f558bccbb4927a8b316/users/f2f1b700b44b4fe8913feb4489718433/roles/0997a26e1c354ef5b0c2730f761b47ed => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:24.998497 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a652656-4a92-4372-90aa-da730e51b2ca None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.998783 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a652656-4a92-4372-90aa-da730e51b2ca None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.999055 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a652656-4a92-4372-90aa-da730e51b2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:25.027690 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3a652656-4a92-4372-90aa-da730e51b2ca None None] MFA Rules not processed for user `f2f1b700b44b4fe8913feb4489718433`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:25.028819 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3a652656-4a92-4372-90aa-da730e51b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:25.093163 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1437/2892] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:25.104083 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8905d-ae56-4354-bfdf-532ea7175537 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:25.105954 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3ef8905d-ae56-4354-bfdf-532ea7175537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:25.167056 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8905d-ae56-4354-bfdf-532ea7175537 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:25.171074 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a328ff-7555-47a9-bb35-f3cbd2d3b98b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344585d4cf44449e8b040d635fe45c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:25.171730 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a328ff-7555-47a9-bb35-f3cbd2d3b98b service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:25.172004 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a328ff-7555-47a9-bb35-f3cbd2d3b98b service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:25.172278 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a328ff-7555-47a9-bb35-f3cbd2d3b98b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:25.180921 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a328ff-7555-47a9-bb35-f3cbd2d3b98b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:25.182384 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a328ff-7555-47a9-bb35-f3cbd2d3b98b service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:25.191394 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1456/2893] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:35.090168 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a652656-4a92-4372-90aa-da730e51b2ca None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:35.090910 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=34 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:35.169953 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a652656-4a92-4372-90aa-da730e51b2ca None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:35.178489 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:35.179382 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:35.179667 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:35.179938 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] PATH_INFO: `/v3/users/f2f1b700b44b4fe8913feb4489718433` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:35.181318 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f1b700b44b4fe8913feb4489718433)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:35.183261 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:35.187159 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:35.240806 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f1b700b44b4fe8913feb4489718433'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:35.254192 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f1b700b44b4fe8913feb4489718433'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:35.254877 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f1b700b44b4fe8913feb4489718433'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:35.255484 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f1b700b44b4fe8913feb4489718433'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:35.265721 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f1b700b44b4fe8913feb4489718433'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:35.280750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1438/2894] 10.222.0.30 () {58 vars in 1223 bytes} [Wed Jul 6 20:43:35 2022] DELETE /identity/v3/users/f2f1b700b44b4fe8913feb4489718433 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:35.285487 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c2bf-3b4b-44e2-8dbe-57d331fc75df None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:35.285753 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c2bf-3b4b-44e2-8dbe-57d331fc75df None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:35.286031 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c2bf-3b4b-44e2-8dbe-57d331fc75df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:35.303177 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0e23c2bf-3b4b-44e2-8dbe-57d331fc75df None None] MFA Rules not processed for user `7606b528dcd64b439b296d632d31e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:35.304338 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0e23c2bf-3b4b-44e2-8dbe-57d331fc75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:35.367695 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1457/2895] 10.222.0.30 () {58 vars in 957 bytes} [Wed Jul 6 20:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:35.377469 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:35.379225 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:35.453243 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93626502-9f23-438d-b498-28a7bbb4c162 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:35.457436 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9001d6-6bd4-4ae6-abe9-4750a6c32591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ad3094ee04495a6ab82c92d458aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:35.458097 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9001d6-6bd4-4ae6-abe9-4750a6c32591 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:35.458375 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9001d6-6bd4-4ae6-abe9-4750a6c32591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:35.458646 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9001d6-6bd4-4ae6-abe9-4750a6c32591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:35.468495 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9001d6-6bd4-4ae6-abe9-4750a6c32591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:35.469973 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9001d6-6bd4-4ae6-abe9-4750a6c32591 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:35.479939 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1439/2896] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:35.766055 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c2bf-3b4b-44e2-8dbe-57d331fc75df None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:35.767579 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0e23c2bf-3b4b-44e2-8dbe-57d331fc75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:35.780188 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c2bf-3b4b-44e2-8dbe-57d331fc75df None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:35.789738 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7606b528dcd64b439b296d632d31e16c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9dceb457eba4f588d26a4848fffb9ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:35.790589 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:35.790860 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:35.791156 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] PATH_INFO: `/v3/projects/2a06b3d80edd4f558bccbb4927a8b316` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:35.792672 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a06b3d80edd4f558bccbb4927a8b316)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:35.794797 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:35.852178 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a06b3d80edd4f558bccbb4927a8b316', 'request_id': 'req-c038605a-1a22-4fe7-b2e2-796aadd462c8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:35.861098 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a06b3d80edd4f558bccbb4927a8b316', 'request_id': 'req-c038605a-1a22-4fe7-b2e2-796aadd462c8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:35.867400 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a06b3d80edd4f558bccbb4927a8b316', 'request_id': 'req-c038605a-1a22-4fe7-b2e2-796aadd462c8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:35.879142 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] The token cache is being invalidate because project 2a06b3d80edd4f558bccbb4927a8b316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:43:35.879335 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:35.880104 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c038605a-1a22-4fe7-b2e2-796aadd462c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:35.882060 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1458/2897] 10.222.0.30 () {58 vars in 1232 bytes} [Wed Jul 6 20:43:35 2022] DELETE /identity/v3/projects/2a06b3d80edd4f558bccbb4927a8b316 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:45.475423 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:45.876067 dv-cinder-848899-1-iscsi devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:44:01.757174 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9001d6-6bd4-4ae6-abe9-4750a6c32591 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:01.759804 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8b9001d6-6bd4-4ae6-abe9-4750a6c32591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:01.857728 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9001d6-6bd4-4ae6-abe9-4750a6c32591 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:01.919029 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcaf510-edde-4b89-9e43-b92d8c5b25f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df36a267464042908bbd8eebc7c40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa631f63e06643bd98323366357c3597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:01.919685 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaf510-edde-4b89-9e43-b92d8c5b25f3 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:01.919986 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaf510-edde-4b89-9e43-b92d8c5b25f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:01.920238 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaf510-edde-4b89-9e43-b92d8c5b25f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:01.922230 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1bcaf510-edde-4b89-9e43-b92d8c5b25f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:01.933750 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcaf510-edde-4b89-9e43-b92d8c5b25f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:01.935338 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcaf510-edde-4b89-9e43-b92d8c5b25f3 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:01.946407 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1440/2898] 10.222.0.30 () {60 vars in 1365 bytes} [Wed Jul 6 20:44:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:44:11.941596 dv-cinder-848899-1-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=67 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}